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Response to Amendments 



1. This action is responsive to pre-amendment A, paper #4, filed 
September 13, 1995; amendment B, paper #9, filed April 25, 1996; 
amendment C, paper #18, filed March 24, 1997; amendment D, paper 
#20^, filed August 11, 1997; amendment E, paper #25, filed December 
4, 1997; and amendment F, paper #26, filed February 9, 1998. 

2. Applicant's amendments responses have been fully considered 
but they are moot in view of new grounds of rejection necessitated 
by the applicant's amendment. 

3. Applicant's request for reconsideration of the restriction has 
been received and considered. Upon a complete review of 
applicant's request for reconsideration, as well as the restriction 
requirement and the pending and previously presented claims, the 
request will be granted because applicant's arguments in section 
"VII" of the request, directed to the presence of linking claims, 
were found to be persuasive. Specifically, the newly added claims 
were found to contain linking claims, as argued by applicant, that 
link applicant's previously elected invention with the newly 
claimed invention. In accordance with MPEP 809.03 the linking 
claims should be examined with the elected invention. Therefore, 
the restriction is hereby withdrawn and an action on the presented 
claims, including the linking claims, follows below. 



Claim Rejections - 35 U.S.C. § 112, 1st Paragraph 
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4. Claims 95-379 are rejected under 35 U.S.C. 112, first 
paragraph, as containing subject matter which was not described in 
the specification in such a way as to enable one skilled in the art 
to which it pertains, or with which it is most nearly connected, to 
make and/or use the invention. 



35 U.S.C. 112, first paragraph states that (emphasis added) 

The specification shall contain a written 
description of the invention, and of the manner and 
process of making and using it, in such full, clear, 
concise, and exact terms as to enable any person skilled 
in the art to which it pertains, or with which it is most 
nearly connected, to make and use the same, and shall set 
forth the best mode contemplated by the inventor of 
carrying out his invention. 



This section of the statute requires that the specification 
include the following: 

(1) a written description of the invention; 

(2) the manner and process of making and using the 
invention (the enablement requirement) ; and 

(3) the best mode contemplated by the inventor of 
carrying out his invention. 

The three requirements are separate and distinct from each 
other . 

The written description requirement is separate and distinct 
from the enablement requirement. In re Barker, 559 F.2d 588, 194 
USPQ 470 (CCPA 1977), cert, denied, 434 U.S. 1064 (1978); Vas- 
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Cath, Inc. v. Mahurkar, 935 F.2d 1555, 19 USPQ2d 1111, 1115 (Feci. 
Cir. 1991) (While acknowledging that some of its cases concerning 
the written description requirement and the enablement requirement 
are confusing, the Federal Circuit reaffirmed that under 35 U.S.C. 
112, first paragraph, the written description requirement is 
separate and distinct from the enablement requirement and gave an 
example thereof) . An invention may be described without the 
disclosure being enabling (e.g., a chemical compound for which 
there is no disclosed or apparent method of making) , and a 
disclosure could be enabling without describing the invention 
(e.g., a specification describing a method of making and using a 
paint composition made of functionally defined ingredients within 
broad ranges would be enabling for formulations falling within the 
description but would not describe any specific formulation) . See 
In re Armbruster, 512 F.2d 676, 677, 185 USPQ 152, 153 (CCPA 1975) 
("[A] specification which describes' does not necessarily also 
'enable' one skilled in the art to make or use the claimed 
invention."). Best mode is a separate and distinct requirement from 
the enablement requirement. In re Newton, 414 F.2d 1400, 163 USPQ 
34 (CCPA 1969). See MPEP 2161. 

Section 2162 of the MPEP provides the policy that is 
underlying 35 U.S.C. 112, first paragraph. Specifically, to obtain 
a valid patent, a patent application must be filed that contains a 
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full and clear disclosure of the invention in the manner prescribed 
by 35 U.S.C. 112, first paragraph. The requirement for an adequate 
disclosure ensures that the public receives something in return for 
the exclusionary rights that are granted to the inventor by a 
patent . The grant of a patent helps to foster and enhance the 
development and disclosure of new ideas and the advancement of 
scientific knowledge. Upon the grant of a patent in the U.S., 
information contained in the patent becomes a part of the 
information available to the public for further research and 
development, subject only to the patentee's right to exclude others 
during the life of the patent. 

In exchange for the patent rights granted, 35 U.S.C. 112, 
first paragraph sets forth the minimum requirements for the quality 
and quantity of information that must be contained in the patent to 
justify the grant. The patentee must disclose in the patent 
sufficient information to put the public in possession of the 
invention and to enable those skilled in the art to make and use 
the invention and must not conceal from the public the best way of 
practicing the invention that was known to the patentee at the time 
of filing the patent application. Failure to fully comply with the 
disclosure requirements could result in the denial of a patent, or 
in a holding of invalidity of an issued patent. 

Section 2164-2164.06 of the MPEP provides further guidance as 
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to what is required for enablement and how this part of the 
requirement is to be interpreted, and these sections are cited 
below, with emphasis added. 

Specifically, the enablement requirement refers to the 
requirement of 35 U.S.C. 112, first paragraph that the 
specification describe how to make and how to use the invention. 
The invention that one skilled in the art must be enabled to make 

and use is that defined bv the claim (s) of the — particular 

application or patent. 

The purpose of the requirement that the specification describe 
the invention in such terms that one skilled in the art can make 
and use the claimed invention is to ensure that the invention is 
communicated to the interested public in a meaningful way. The 
information contained in the disclosure of an application must be 
sufficient to inform those skilled in the relevant art how to both 
make and use the claimed invention. Detailed procedures for making 
and using the invention may not be necessary if the description of 
the invention itself is sufficient to permit those skilled in the 
art to make and use the invention. Further, a patent claim is 
invalid if it is not supported by an enabling disclosure. 

Any analysis of whether a particular claim is supported by the 
disclosure in an application requires a determination of whether 
that disclosure, when filed, contained sufficient information 
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regarding the subject matter of the claims as to enable one skilled 
in the pertinent art to make and use the claimed invention. The 
test of enablement is whether one skilled in the art could make or 
use the claimed invention from the disclosures in the patent 
coupled with information known in the art without undue 
experimentation . United States v. Telectronics, Inc. , 857 F.2d 
778, 8 USPQ2d 1217 (Fed. Cir. 1988); In re Stephens, 529 F.2d 
1343, 188 USPQ 659 (CCPA 1976). Determining enablement is a 
question of law based on underlying factual findings. In re 
Vaeck, 947 F.2d 488, 495, 20 USPQ2d 1438, 1444 (Fed. Cir. 1991); 
Atlas Powder Co. v. E.I. duPont de Nemours & Co. , 750 F.2d 1569, 
224 USPQ 409 (Fed. Cir. 1984). 

The fact that experimentation may be complex does not 
necessarily make it undue, if the art typically engages in such 
experimentation. M.I.T. v. A.B. Fortia, 774 F.2d 1104, 227 USPQ 
428 (Fed. Cir. 1985) . The test of enablement is not whether any 
experimentation is necessary, but whether, if experimentation is 
necessary, it is undue. In re Angstadt, 537 F.2d 498, 190 USPQ 
214 (CCPA 1976) . 

Whether undue experimentation is needed is not based upon a 
single factor, but rather a conclusion reached by weighing many 
factors. Many of these factors have been summarized in In re 
Wands, 858 F.2d 731, 8 USPQ2d 1400 (Fed. Cir. 1988) as follows: 
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(1) 


The quantity of experimentation necessary (time and expense) ; 


(2) 


The 


amount of direction or guidance presented; 


(3) 


The 


presence or absence of working examples of the invention; 


(4) 


The 


nature of the invention; 


(5) 


The 


state of the prior art; 


(6) 


The 


relative skill of those in the art; 


(7) 


The 


predictability or unpredictability of the art; and 


(8) 


The 


breadth of the claims. 



Although, it is not necessary that every enablement analysis 
consider all of the factors . 



While an example may be supplied, compliance with the 
enablement requirement of 35 U.S.C. 112, first paragraph does not 
turn on whether an example is disclosed. An example may be 
"working" or "prophetic." A working example is based on work 
actually performed. A prophetic example describes an embodiment of 
the invention based on predicted results rather than work actually 
conducted or results actually achieved. 

The specification need not contain an example if the invention 
is otherwise disclosed in such manner that one skilled in the art 
will be able to practice it without an undue amount of 
experimentation. In re Borkowski, 422 F.2d 904, 164 USPQ 642 
(CCPA 1970) . Lack of a working example , however, is a factor to be 
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considered especially in a case involving an unpredictable and 
undeveloped art. 

Further, as stated in section 2164.05 of the MPEP, once the 
examiner has established a reasonable basis to question the 
enablement provided for the claimed invention, the burden falls on 
the applicant to present persuasive arguments, supported by 
suitable proofs where necessary, that one skilled in the art would 
be able to make and. use the claimed invention using the disclosure 
as a guide. In re Brandstadter, 484 F.2d 1395, 179 USPQ 286 (CCPA 
1973) . In making the determination of enablement, the examiner 
shall consider the original disclosure and all evidence in the 
record, weighing evidence that supports enablement against evidence 
that the specification is not enabling. 

The applicant may attempt to overcome the examiner's doubt 
about enablement by pointing to details in the disclosure but may 
not add new matter . Applicant may also submit factual affidavits 
under 37 CFR 1.132 or cite references to show what one skilled in 
the art knew at the time of filing the application. Additionally, 
the state of the art existing at the filing date of the application 
is used to determine whether a particular disclosure is enabling as 
of the filing date. Publications dated after the filing date 
providing information publicly first disclosed after the filing 
date generally cannot be used to show what was known at the time of 
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filing. In re Gunn, 537 F.2d 1123, 190 USPQ 402 (CCPA 1976). 
While a later dated publication cannot supplement an insufficient 
disclosure in a prior dated application to make it enabling, 
applicant can offer the testimony of an expert based on the 
publication as evidence of the level of skill in the art at the 
time the application was filed. Gould v. Quigg, 822 F.2d 1074, 
3 USPQ2d 1302 (Fed. Cir. 1987). 

Likewise, the examiner can use later appearing art as 
evidence of the state of the art existing on the filing date of the 
application. In re Hogan, 559 F.2d 595, 194 USPQ 527 (CCPA 1977). 
In In re Wright, 27 USPQ2d 1510 (Fed. Cir. 1993) an article 
published five years after the filing date of the application 
adequately supported the examiner's position that the physiological 
activity of certain viruses was sufficiently unpredictable so that 
a person skilled in the art would not have believed that the 
success with one virus and one animal could be extrapolated 
successfully to all viruses with all living organisms. Claims not 
directed to the specific virus and the specific animal were held to 
be nonenabled. 

Section 2164.06 of the MPEP gives examples of enablement 
issues which are repeated below. It is common that the doubt 
arises about enablement because information is missing about one or 
more essential parts or relationships between parts which one 
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skilled in the art could not develop without undue experimentation. 
In such a case, the examiner should specifically identify what 
information is missing and why the missing information is needed to 
provide enablement . 

(a) Electrical and mechanical devices or processes 

For example, a disclosure of an electrical circuit apparatus, 
depicted in the drawings by block diagrams with functional labels, 
was held to be nonenabling in In re Gunn, 537 F.2d 1123, 190 USPQ 
402 (CCPA 1976) . There was no indication in the specification as 
to whether the parts represented by boxes were "off the shelf" or 
must be specifically constructed or modified for applicant's 
system. Also there were no details in the specification of how the 
parts should be interconnected, timed and controlled so as to 
obtain the specific operations desired by the applicant . In In re 
Donohue, 550 F.2d 1269, 193 USPQ 136 (CCPA 1977), the lack of 
enablement was caused by lack of information in the specification 
about a single block labeled "LOGIC" in the drawings. 

In re Ghiron, 442 F.2d 985, 169 USPQ 723 (CCPA 1971), 
involved a method of facilitating transfers from one subset of 
program instructions to another which required modification of 
prior art "overlap mode" computers. The Board rejected the claims 
on the basis, inter alia, that the disclosure was insufficient to 
satisfy the requirements of 35 U.S.C. 112, first paragraph and was 



Serial Number: 08/464,034 Page 12 

Art Unit: 2723 

affirmed. The Board focused on the fact that the drawings were 
"block diagrams, i.e., a group of rectangles representing the 
elements of the system, functionally labeled and interconnected by 
lines." 169 USPQ at 727. The specification did not particularly 
identify each of the elements represented by the blocks or the 
relationship therebetween, nor did it specify particular apparatus 
intended to carry out each function. The Board further questioned 
whether the selection and assembly of the required components could 
be carried out routinely by persons of ordinary skill in the art. 

An adequate disclosure of a device may require details of how 
complex components are constructed and perform the desired 
function. The claim before the court in In re Scarbrough, 500 
F.2d 560, 182 USPQ 298 (CCPA 1974) was directed to a system which 
comprised several component parts (e.g., computer, timing and 
control mechanism, A/D converter, etc.) only by generic name and 
overall ultimate function . The court concluded that there was not 
an enabling disclosure because the specification did not describe 
how "' complex elements known to perform broadly recited functions in 
different systems would be adaptable for use in Appellant's 
particular system with only a reasonable amount of experimentation " 
(emphasis added) and that "an unreasonable amount of work would be 
required to arrive at the detailed relationships appellant says 
that he has solved." 182 USPQ at 302. 
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With respect to the pending application, these rejected claims 
are all replete with terms and limitations that are either: (1) not 
at all disclosed in the originally filed specification, or (2) are 
only briefly mentioned and are not fully described or enabled. 
Each and every limitation in each of the claims must be described 
in full, clear, concise, and exact terms and must be enabled to 
satisfy the requirements of 35 U.S.C. 112 . The originally filed 
specification does not provide a full, clear, concise, or exact 
description of the claim limitations and does not allow one of 
ordinary skill in the art to make or use the claimed invention 
without undue experimentation or delay. Therefore, the 

requirements of 35 U.S.C. 112, first paragraph are not satisfied. 

All of the above indicated claims are replete with instances 
of limitations that are not enabled and/or not disclosed. In 
general, each limitation that is recited in the claims is not 
enabled. The claims recite interconnections and interrelations 
limitations (language such as "coupled to" and "in response to") 
that is not supported or described in the originally filed 
specification. The specification does not contain any disclosure 
directed to these claimed interconnections and interrelations. 
Further, the individual limitations are not enabled in, and of, 
themselves. The specification, at best, simply mentions some of 
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the claimed words (or variations thereof) without providing any 
actual disclosure as to how the elements are to be constructed or 
how the elements are to be used or how they function. Applicant is 
required to have enabling support for each and every limitation 
that is recited in the claims to be in accordance with 35 U.S.C. 
112, first paragraph. In view of the large number of claims and 
the fact that essentially all of the claimed limitations are 
lacking enablement, the specifics of each claim will not be 
reproduced. To do so would effectively reproduce all of the claims 
and take up upwards of 100 pages. A few examples will be provided 
below so that applicant will be fully aware of the problems that 
the examiner is making reference to in the claims. Therefore, it 
is hereby made explicitly clear that these are only exemplary and 
are not all inclusive. All of the claims are non-enabled, with 
each limitation, as well as all of the claimed interconnections and 
interrelations, not being supported, and in many instances not even 
mentioned, in the originally filed specification. Further, none of 
the claimed elements or interconnections or interrelations are 
shown in the drawings. 

The following are some examples of the limitations that are 
not enabled: 

(1) Additionally, the claims repeatedly recite various 
interconnections and interrelations between the claimed elements. 
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For example, claim 98 recites (in part, with emphasis added) : 

a first memory storing prior pixel image information, the 
prior pixel image information representing a prior image; 

a second memory storing next pixel image information, the next 
pixel image information representing a next image; 

a spatial interpolation circuit coupled to the first memory 
and coupled to the second memory, the spatial interpolation circuit 
generating spatial interpolation information in response to the 
prior pixel image information stored by the first memory and in 
response to the next pixel image information stored by the second 
memory; 

a subpixel vector change circuit coupled to the first memory 
and coupled to the second memory, the subpixel vector change 
circuit generating subpixel vector change information having 
subpixel resolution in response to the prior pixel image 
information stored by the first memory and in response to the next 
pixel image information stored by the second memory; 

a transform processor coupled to the spatial interpolation 
circuit, the transform processor generating transformed image 
information in response to spatial interpolation information 
generated by the spatial interpolation circuit; 

a weight circuit generating weight information; 

a scale factor circuit generating scale factor information; 

a weighting and scaling circuit coupled to the scale factor 
circuit, coupled to the weight circuit, and coupled to the 
transform processor, the weighting and scaling circuit generating 
scaled weighted image information in response to the transformed 
image information generated by the transform processor, in response 
to the scale factor information generated by the scale factor 
circuit, and in response to the weight information generated by the 
weight circuit; 

a resolution reduction circuit coupled to the weighting and 
scaling circuit, the resolution reduction circuit generating 
reduced resolution image information in response to the scaled 
weighted image information generated by the weighting and scaling 
circuit ; 

an image communication link coupled to the resolution 
reduction circuit, the image communication link communicating 
output image information in response to the reduced resolution 
image information generated by the resolution reduction circuit; 

a vector communication link coupled to the subpixel vector 
change circuit, the vector communication link communicating output 
subpixel vector information in response to the subpixel vector 
change information generated by the subpixel vector change circuit; 
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a display circuit coupled to the resolution reduction circuit, 
the display circuit generating display image information in 
response to the reduced resolution image information generated by 
the resolution reduction circuit; and 

a display device coupled to the display circuit, the display 
device displaying an image in response to the display image 
information generated by the display circuit. 

Nearly all of the claims in the application contain the same uses 
of the terms "coupled to" and "in response to" as exemplified 
above. The specification does not contain support for the claimed 
interconnections (the "coupled to" language) of elements. Nor does 
the specification contain support for the claimed interrelations 
(the "in response to" language) between the elements. The 
specification must contain enabling support for each and every 
claimed interconnection (i.e., all of the elements that are recited 
as being "coupled to" other elements) . Additionally, the 
specification must contain enabling support for each and every 
claimed interrelation (i.e., all of the elements that are recited 
as operating "in response to" other elements) . The specification 
does not provide for either of these critical elements. The 
originally filed specification does not disclose the coupling of 
the claimed elements to one another, nor does it disclose how these 
elements are "coupled to" one another. Even if the specification 
did recite that the claimed elements were connected to one another 
( which it does not ) , it would still not be enabling as it must 
still disclose how the elements are connected to one another. What 
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elements are used to couple the various elements also needs to be 
disclosed. If the elements used to perform the coupling are not 
disclosed, and there is no enabling disclosure as to how the 
claimed elements are "coupled to" one another, the claimed 
recitations can not be considered to be enabled. Therefore, one of 
ordinary skill in the art would require undue experimentation and 
burden to make or use the claimed -invention. Further, there are no 
drawings that show how the claimed elements are connected to one 
another or how they interact with one another. Also, there are no 
drawings that show the coupling elements or what the coupling 
elements are. Also, there are no drawings that show the claimed 
functions of the variously claimed elements operating "in response 
to" one another. Every claimed limitation is to be shown in the 
drawings, or the limitation (s) must be canceled from the claim (s). 

(2) As to claims at most of claims 295-379, as well as many 
others, these claims all recite making one product or another. 
Specifically, these claims respectively recite making the following 
products: a vehicle product"; "a building product"; "a subpixel 
resolution product"; "a signal product"; "a disk memory product"; 
"an information product"; "a entertainment product"; "a designed 
product"; "a manufactured product"; "a training product"; "a 
processed product"; "an oil product"; "a mineral product"; "an 
electronic product"; "an architectural product"; "a game product"; 
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"a natural resource product"; "a service product"; and "a location 
product". There is no disclosure of making a product in the 
specification as originally filed. A review of the specification 
shows that, other than the use of the term "product" in a 
mathematical sense (such as for multiplication or a sum-of- 
products), the only reference of a product is on page 454 which 
recites " [A] lthough the final product of a graphic art system may 
be static photographs, real time operation permits an operator to 
efficiently and rapidly configure images." (emphasis added). This 
is in a section entitled "Special Effects Application", and does 
not appear to be related to the other elements (including 
"generating spatial interpolation information", "generating 
subpixel vector change image information", "generating transformed 
image information", "generating scale factor information", and 
"generating scaled weighted image information") recited in the 
claims. Additionally, the type of "products" recited in the above 
claims has very little if any support in the specification. For 
example, the recitation of "entertainment" is only on page 48 6 ("An 
arcade game application is representative of many different types 
of video disk image processing applications; including interactive 
entertainment applications, simulation applications, and training 

applications." in the discussion of arcade games); the recitation 
of "oil" or "mineral" only appears on page 47 9 ("Companies involved 
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in exploration, such as for oil and minerals ; in weather, such as 

TV networks and airlines; in geography, such real estate 
developers; and government agencies needing information on weather, 
troop and equipment movements, and other situations will obtain 
images for analysis.") There appears to be no recitation at all of 
the other claimed products such as making a product "in response to 
information stored in the reconstructed image memory". 
Additionally, there appears to be no recitation at all of the other 
claimed products such as an "information product", a "physical 
product", a "designed product", a "manufactured product", an 
"electronic product" or an "architectural product". Further, the 
specification does not provide any support as to how these 
"products" are made nor as to how they are made "in response to 
information stored in the reconstructed image memory" as recited in 
the claims. Further, there is no disclosure as to exactly what 
these claimed "products" are intended to be. Therefore, one of 
ordinary skill in the art would require undue experimentation and 
burden to make or use the claimed invention. 

(3) As to claims 100-104, 106, and many other, the claimed 
limitations of "an image communication link " , "a vector 
communication link", "a communication link coupled to the . . . 
communicating output image information in response to the ..." (a 
communication link is claimed coupled to a variety of different 
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nonenabled circuits and couplings, and communicates image 
information in response to a variety of different nonenabled 
circuits and couplings) are not enabled by the originally filed 
specification. The only recitation in the specification of 
"communications link" (or similar language) is "Input sources can 
be image sensors, image generators, memories, other image 
processing systems, digitizers, communication link s, and multitudes 
of other input sources. Output destinations can be display 
monitors, pattern recognition ( devices, artificial intelligence 
devices, memories, other image processing systems, communication 
links , and multitudes of other output destinations." (page 64, 
lines 2-5, emphasis added) . Therefore, it is clear that the 
originally filed specification does not contain support for the 
claimed recitations noted above, as the specification never recites 
"an image communication link", "a vector communication link", or 
supports the communication link couplings to a variety of circuits 
or for communicating in response to a variety of different 
circuits, nor how this will function, nor how this would be 
structured and constructed. Therefore, one of ordinary skill in 
the art would require undue experimentation and burden to make or 
use the claimed invention. 

(4) At least claim 101 recites a "Fourier transform 
processor". However, the term "Fourier" does not even appear in 
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the specification . Neither does the term "Fourier transform" 
appear in the specification. If the claimed terms "Fourier" or 
"Fourier transform" do not appear in the originally filed 
specif ication, the terms CAN NOT be e^ahl Further, the 

specification also does not support the claimed interrelations and 
interconnections. Further, the specification does not disclose how 
the "Fourier transform processor" is constructed or how it 
functions. Additionally, the "Fourier transform processor" is not 
shown in the drawings, nor are the claimed interconnections and 
interrelations. Therefore, one of ordinary skill in the art would 
require undue experimentation and burden to make or use the claimed 
invention. 

(5) Most of the claims such as claim 98 recite "a subpixel 
vector change circuit . . . generating subpixel vector change 
information" or other similar limitations that generally always 
include the phrase "subpixel vector change". Not only does the 
specification lack any recitation of the claimed "subpixel vector", 
it further does not appear to disclose any relationship between 
"subpixel" and "vector" anywhere or in any context together. 
Therefore, the specification cannot enable this claimed feature. 
Even if the specification did provide for a "subpixel vector", it 
would also have to provide for "subpixel vector change 
information", which is further not found anywhere in the disclosure 
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including the drawings. Even if the specification did recite this 
feature, it would also have to disclose how to make and use the 
claimed "circuit" or how one of ordinary skill would go about 
"generating" the "subpixel vector change information", which the 
disclosure does not show in the drawings or explain in the 
specification. The disclosure must also be enabling for the 
couplings to the claimed different memories, which it further does 
not do. Since the specification is devoid of any recitation of the 
claimed "subpixel vector change" "circuit" or "information", this 
feature is therefore not supported. Thus, one of ordinary skill in 
the art would require undue experimentation and burden to make or 
use the claimed invention. 

5. To summarize the above rejections, the claims all recite 
numerous limitations that do not have support in the originally 
filed specification (substantially all of the claimed limitations 
do not have enabling support in the specification) . The claims 
recite interconnections and interrelations between the claimed 
elements that are not disclosed in the specification . There is no 
disclosed embodiment that shows all of the claimed limitations of 
any of the claimed embodiments, nor is there any drawing that shows 
any of the claimed embodiments. There is no antecedent basis in 
the originally filed specification for many of the claimed 
limitations . 
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6. Additionally, since the limitations referenced (both 
explicitly and implicitly) to in the 112, first paragraph 
rejection, above, are not supported by the originally filed 
specification these limitations constitute new matter and should 
therefore be canceled in accordance with 35 U.S.C. 132. 

7. In order to traverse this rejection, Applicant should do at 
least the following: 

1) Show enabling support in the original specification for 
each and every feature recited in the claims, including (but not 
limited to only) those features specifically mentioned above; 

2) Show enabling support in the specification of how each 
circuit/means recited in the claims, including (but not limited to 
only) those features specifically mentioned above, generates its 
corresponding type of information as claimed; 

3) Show enabling support in the original specification for 
each claimed embodiment , including each claimed interconnective and 
interoperative relationship being specifically claimed in each 
embodiment ; 

4) Show how the original specification enables the making of 
various types of products as specifically recited in the claims. 

8. Any issue above not addressed in applicant's response (i.e., 



i 
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any feature, embodiment or any interconnective or interoperative 
relationship, as well as all other recitations objected to in the 
paragraphs above) that is not specifically addressed by applicant 
will be considered as an admission by Applicant that said feature, 
embodiment, interoperative/interconnective relationship, etc. is 
not supported or enabled by the specification. 

9. The drawings are objected to under 37 CFR 1.83(a). The 
drawings must show every feature of the invention specified in the 
claims. Therefore, the various features, along with the claimed 
interconnections f that are pointed out in the section above 
(directed to 112, 1st paragraph, lack of enablement) must be shown 
or the feature (s) canceled from the claim(s) . No new matter should 
be entered. These features include all those recited in the 
claims, including (but not limited to only) those features 
specifically mentioned above. Further, the drawings must show each 
claimed embodiment , along with each claimed variation that is 
claimed of each embodiment. To reiterate, all of the claimed 
limitations r including all of the interconnections and variations 
must be shown in the drawings or the features must be canceled from 
the claims . 



10. The specification is objected to as failing to provide proper 
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antecedent basis for the claimed subject matter. See 37 
CFR 1.75 (d) (1) and MPEP § 608. 01 (o) . 

37 C.F.R. 1.75(d)(1) requires that: 

"the terms and the phrases used in the claims must find clear 
support or antecedent basis in the description so that the 
meaning of the terms in the claims may be ascertainable by 
reference to the description". 

Correction of the following is required: Numerous terms in the 
claims do not find clear support or antecedent in the descriptive 
portion of the specification. Specif ically, all of the terms 
objected to (above) (both specifically and in general) directed to 
the claims lacking clear support and lacking antecedent basis in 
the originally filed specification under 35 U.S.C. 112, 1st 
paragraph, do not have antecedent in the specification. Rather 
than repeating the extensive discussion of these terms, the above 
statements are incorporated herein by reference. Applicant is 
required to show where he has antecedent basis in the specification 
for each term recited in the claims. It is hereby noted that this 
differs from the 112 rejection, above, in that 1.75(d)(1) requires 
that the terms used in the claims have "clear support or antecedent 
basis in the description" while 112 requires that the terms be 
enabled to one of ordinary skill in the art. The reference to the 
above 112 rejection is simply to not need to repeat substantially 
the same references as above, as the terms that do not have 
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enablement in the specification also do not have clear antecedent 
basis in the specification (and, in many instances, are not even 
used in the originally filed specification) . 

11. Claims 95-379 are rejected under 35 U.S.C. 112, first 
paragraph, as containing subject matter which was not described in 
the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor (s), at the time the 
application was filed, had possession of the claimed invention- 
Numerous terms in the claims do not find clear support or 

antecedent in the descriptive portion of the specification. 
Specifically, all of the terms objected to in the 112, 1st 
paragraph (above) directed to the claims lack clear support and 
lack antecedent basis in the originally filed specification. 
Rather than repeating the extensive discussion of these terms, the 
above statements are incorporated herein by reference. Applicant 
is required to show where he has antecedent basis in the 
specification for each and every term recited in the claims. 

12. The Examiner would like to note that a review of this 
application, and other related applications, reveals that there are 
numerous claims that contain the same basic limitations (or 
complete claim) with only a changed modifier (such as an adjective) 
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to a limitation. For example, the claims in this application 
directed to various products (295+, for example) are substantially 
identical to claims 304+ of S.N. 08/469,888, docket number 791, 

(for example; most of the other pending applications also contain 
similar claims directed to "products") except for the product (in 
this application) being made "in response to the multiplexed image 
information" while the same products in the *888 applications are 
made "in response to the window image". The specification is 
unclear as to how apparently very different processes can be used 
to make the same product. It appears that applicant has submitted 
very similar claims throughout a large number of applications (up 
to all 100 related applications with docket numbers from 700-799, 
and possibly more) with the only differences being changes in 
modifiers/adjectives for the limitations. Applicant is reminded 
that a clear line of demarcation should be maintained between each 
of the applications. Further, applicant is requested to indicate 

( preferably in each application ) exactly how claims to allegedly 
different systems (such as the systems in the above referenced 
applications) can be performed by the same elements. It appears 
that applicant has simply changed the modifiers in the claims in an 
attempt to allegedly change the type of system being claimed. 
Simply by changing the modifiers does not necessarily change the 
invention (particularly when the modifiers are themselves not 
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enabled) . A review of the claims in these applications clearly 
shows that they are (in general) substantially all the same except 
for the modifiers. The only differences appear with the inclusion 
of the modifiers/adjectives. However, these modifiers are only 
stuck into the claim language without any relation to either the 
structure (for apparatus claims) or functions (for method claims) 
being recited. Thus, it is clear that the "structure" being 
recited is independent of the modifiers. 

13. The examiner will like to point out that, as required by MPEP 
608. 01 (p), a disclosure in an application, to be complete, must 
contain such description and details as to enable any person 
skilled in the art or science to which the invention pertains to 
make and use the invention as of its filing date, In re Glass, 492 
F.2d 1228; 181 USPQ 31 (CCPA 1974). While the prior art setting 
may be mentioned in general terms, the essential novelty, the 
essence of the invention, must be described in such details, 
including proportions and techniques, where necessary, as to enable 
those persons skilled in the art to make and utilize the invention. 
An application as filed must be compete in itself in order to 
comply with 35 U.S.C. §112. Material nevertheless may be 
incorporated by reference, Ex parte Schwarze, 151 USPQ 426 (Bd. 
App. 1966) . An application for a patent when filed may incorporate 
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"essential material" by reference to (1) a U.S. Patent or (2) an 
allowed U.S. application in which the issue fee has been paid, 
subject to the conditions set forth below. "Essential material is 
defined as that which is necessary to (1) describe the claimed 
invention, (2) provide an enabling disclosure of the claimed 
invention, or (3) describe the best mode (35 U.S.C. 112). In any 
application which is to issue as a U.S. Patent, essential material 
may not be incorporated by reference to (1) patents or publications 
published by foreign countries or a regional patent office, (2) 
non-patent publications, (3) a U.S. patent or application which 
itself incorporates "essential material" by reference, or (4) a 
foreign application. See In re Fouche, 439 F2d. 1237, 169 USPQ 429 
(CCPA 1971) . 

Nonessential subject matter may be incorporated by reference 
to (1) patents or applications published by the United States or 
foreign countries or regional patent offices , (2 ) prior filed, 
commonly owned U.S. applications, or (3) non-patent publication. 
Nonessential subject matter is subject matter referred to for 
purposes of indicating the background of the invention or 
illustrating the state of the art. 

14. At this time it is assumed that these incorporations do not 
incorporate "essential" subject matter since these incorporations 
include the incorporation of material from sources other than (1) 
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a U.S. Patent or (2) an allowed U.S. application. If, during the 
prosecution of this application, it should become apparent that 
these incorporations do indeed improperly incorporate "essential" 
subject matter (such as applicant attempting to rely upon one or 
more of the references to overcome the various 112 rejections) 
applicant will, at that time, be required to remove the (then) 
improper incorporation. 

15. For applicant's convenience, the various incorporations are 
replicated below: 

"This application is a continuing application continuing from 
application IMPROVED ARCHITECTURE S/N 07/289,355 filed on December 
22, 1988 now pending; where this parent application S/N 07/289,355 
is a continuing application continuing from parent application 
IMPROVED IMAGE PROCESSING ARCHITECTURE S/N 06/663,094 filed on 
October 19, 1984 where this parent application S/N 06/663,094 is a 
continuation in part of two patent applications: 1. IMPROVED MEMORY 
ARCHITECTURE HAVING MULTI-DIMENSIONAL ADDRESSING by Gilbert P. 
Hyatt Serial No. 06/661, 649 filed on October 17, 1984 and 2. 
IMPROVED MEMORY ARCHITECTURE HAVING A MULTIPLE BUFFER OUTPUT 
ARRANGEMENT by Gilbert P. Hyatt Serial No. 06/662,211 filed on 
October 18, 1984; where the benefit of the filing dates of all of 
the above ancestor applications is claimed in accordance with 35 
U.S.C. 120 and other authorities therefor and where ancestor 
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applications Serial No. 06/661,649; Serial No. 06/662,211; and 
Serial No. 06/663,094 are herein incorporated by reference ." on 
page 2, emphasis added; 

"Serial processor 130D can be implemented with a difference 
equation processor, such as a digital differential analyzer (DDA) 
as discussed in Patent No. 3,586,837; which is incorporated herein 
by reference ." on page 35, emphasis added; 

"Alternately, database memory 131B can be implemented with an 
analog CCD memory; such as discussed in U.S. Patent No. 4,209,853; 
4,209,852; No. 4,209,843; and 4,322,819 and U.S. Patent 
applications S/N 812,285; S/N 844,765; and S/N 160,871; which are 
herein incorporated by reference ." on pages 45-46, emphasis added; 

"Weighting and integration techniques are discussed for a 
process-on-the-f ly arrangement in patent No. 4,209,843; which is 
herein incorporated by reference ." on page 53, emphasis added; 

"Video tapes have been filed in the disclosure documents 1. 
Disclosure Document No. 126,823 filed on March 19, 1984. 2. 
Disclosure Document No. 126,825 filed on April 26, 1984. 3. 
Disclosure Document No. 127,956 filed on June 4, 1984, which are 
herein incorporated by reference ." on page 146, emphasis added; 

"The disk drives are manufactured by Siemens as the FDD 100-8; 
the drive enclosure is manufactured by International 
Instrumentation, Incorporated; and the DMA Controller is 
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manufactured by CompuPro as the Disk 1 DMA Controller; all 
described in detail in the referenced manuals. The terminal is 
manufactured by Applied Digital Data Systems, Inc. (ADDS) as the 
Model Viewpoint/3A Plus; described in detail in the referenced 
manual- The printers include a dot matrix printer manufactured by 
Star Micronics, Inc. as the Gemini-10, a dot matrix printer 
manufactured by Epson as the FX-100, and a daisywheel printer 
manufactured by Smith-Corona as the TP-I; all described in detail 
in the referenced manuals. The computer is implemented with a 
cabinet manufactured by Fulcrum Computer Products as the 18080 
Microcomputer System Cabinet and having a backplane S-100 board 
manufactured by CPA which is described in detail in the referenced 
CPA manual." on page 2 96; 

"The following documents provide supplemental data on the 
computer system and are herein incorporated by reference . 1. 
Technical Manual, Siemens, OEM Floppy Disk Drive FDD 100-8, 
Technical Manual, Model 100-80. 2. Manual, International 
Instrumentation, Incorporated, Universal Disk Enclosures, General 
Information/Pricing, 1982. 3. User Manual, CompuPro Division of 
Godbout Electronics, Disk 1 Arbitrated 24 Bit DMA Floppy Disk 
Controller, 1981. 4. User's Manual, Applied Digital Data Systems, 
Inc., Viewpoint/3A Plus, 518-31100. 5. Operation Manual, Star 
Micronics, Inc., Gemini-10. 6. Operation Manual, Epson, FX Printer, 
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1983. 7. Operator's Manual, Smith-Corona, TP-I. 8. Functional 
Description, CP-A, Revision 1. 9. Technical Manual, CompuPro 
Division of Godbout Electronics, 8085/8088 CPU Dual CPU, 2/83. 10. 
Technical Manual, CompuPro Division of Godbout Electronics, RAM 16 
static memory, 4/82. 11. Technical Manual, CompuPro Division of 
Godbout Electronics, RAM 17 64K Static memory, 9/82. 12. User's 
Manual, CompuPro Division of Godbout Electronics, System Support 1, 
8/81. 13. Technical Manual, CompuPro Division of Godbout 
Electronics, Interfacer 2, 4/82. 14. The CP/M Handbook with MP/M, 
by Rodnay Zaks, published by Sybex, 1980. 15. CP/M Primer, by 
Stephen Murtha and Mitchell Waite, published by Howard W. Sams & 
Co., Inc., 1980. 1 298 16. An Introduction to CP/M Features and 

Facilities, published by Digital Research, January 1978. 17. 
Microsoft Basic Reference Book, published by Microsoft, 19 7 9. 

18. Microsoft Basic Compiler Documentation, published by Microsoft. 

19. The Basic Handbook (2nd Edition), by David Lien, published by 
Compusoft Publishing, 1981. 20. Microsoft Basic (2nd Edition), by 
Ken Knecht, published by Dilithium Press, 1983. 21. Basic Basic 
(2nd Edition), by James Coan, published by Hayden Book Company, 
Inc., 1978. 22. Computer Compatible Joystick Instruction, 
applicable to: Apple-II." on pages 298-299, emphasis added; 

"A list of these specification sheets and catalogs is provided 
hereinafter and the materials referenced therein are incorporated 
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herein by reference . For example , the 74LSOO, 74ALSOO, and 74ASOO 
specifications are set forth in the referenced Texas Instruments 
and Motorola catalogs and the Intel 6216 bus interface and the 
Intel 2149 RAM specifications are 'set forth in the referenced Intel 
catalogs; which are herein incorporated by reference . 1. Texas 
Instruments, ALS/AS Logic Circuits Data Book, 1983. 2. Texas 
Instruments, The TTL Datas Book, Volume 3, 1984. 3. Texas 
Instruments, The TTL Pocket Data Book, 1983. 4. Intel, Component 
Data Catalog, 1981. 5. Intel, Memory Components Handbook, 1984. 6. 
Motorola, Schottky TTL Databook, 1981. Various circuits used in 
the experimental system are described in the following list of 
component specifications, which are herein incorporated by 
reference . 1. TRW, LSI D/A Converters, TDC1016J-8/9/10 . 2. TRW, 
Monolithic Video D/A Converters; TDC1016J-8, TDC0106J-9, 
TDC1016J-10; 1979. 3. Texas Instruments, TMS-4016, 2048-Word By - 
S-Bit Static RAM . 4. National Semiconductor, ADC0800 8-Bit A/D 
Converter. 5. National Semiconductor, MM5321 'TV Camera Sync 
Generator. 6. Signetics, Hex Buffers/Inverters; 8T95, 96, 97, 98. 
7. Mitsubishi; M58725P, S; P-15, S-15; 16384-BIT (2048-word by B-bit 
static RAM." on pages 372-373, emphasis added; 

"One form of projection display is disclosed in Patent No. 
4,435,732; which is incorporated herein by reference ." on page 469, 
emphasis added; and 
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"A disclosure document has been filed in the U.S. Patent and 

Trademark Office on or about October 18, 1984 No. which is 

herein incorporated by reference . This disclosure document has 
copies of many of the documents and specification sheets referenced 
herein as follows. 1. National Semiconductor specification sheet 
for the MM5321 synchronization generator. 2. Signetics 
specification sheet for the ST95, 96, 97, 98 hex buffers/inverters. 
3. National Semiconductor specification sheet for the ADc 0800 A/D 
converter. 4. Texas Instruments specification sheet for the 
TNS-4016 RAM . 5. TRW specification sheet for the TDC1016J-8, 
TDC1016J-9, TDC1016J-10 video D/A converters. 6. Mitsubishi 
Electric specification sheet for the 1458725P, S;P-15, S-15, RAMS. 
7. Computer Compatible Joystick Instruction sheet. S. CompuPro CPU 
8085/88 Technical Manual. 9. Viewpoint/3A Plus User's Manual. 10. 
CompuPro RAM 17 Technical Manual. 11. CompuPro RAM 16 Technical 
Manual. 12. CompuPro 8080 Multi-User Monitor program listing. 13. 
CompuPro System Support 1 User Manual. 14. International 
Instrumentation Incorporated Universal Disk Enclosures manual. 15. 
Siemens OEM Floppy Disk Drive FDD 100-8 manual. 16. CompuPro Disk 
1 User Manual." on pages 575-576. 

16. Claims 95-379 are rejected under 35 U.S.C. 112, first 
paragraph, as containing subject matter which was not described in 
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the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor (s), at the time the 
application was filed, had possession of the claimed invention. 



35 U.S.C. 112, first paragraph recites (with emphasis added) 

that : 



The specification shall contain a 
written description of the invention , and of 
the manner and process of making and using it , 
in such full, clear, concise, and exact terms 
as to enable any person skilled in the art to 
which it pertains, or with which it is most 
nearly connected, to make and use the same , 
and shall set forth the best mode contemplated 
by the inventor of carrying out his invention . 



Further, 37 C.F.R. 1 . 7 5 (a-d) reguires (with emphasis added) 



that: 



"(a) The specification must include a 
written description of the invention or 
discovery and of the manner and process of 
making and using the same , and is required to 
be in such full, clear, concise, and exact 
terms as to enable any person skilled in the 
art or science to which the invention or 
discovery appertains, or with which it is most 
nearly connected, to make and use the same . 

(b) The specification must set forth the 
precise invention for which a patent is 
solicited, in such manner as to distinguish it 
from other inventions and from what is old . It 
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must describe completely a specific embodiment 
of the process, machine, manufacture, 
composition of matter or improvement invented, 
and must explain the mode of operation or 
principle whenever applicable . The best mode 
contemplated by the inventor of carrying out 
his invention must be set forth. 

(c) In the case of an improvement, the 
specification must particularly point out the 
part or parts of the process, machine, 
manufacture, or composition of matter to which 
the improvement relates, and the description 
should be confined to the specific improvement 
and to such parts as necessarily cooperate 
with it or as may be necessary to a complete 
understanding or description of it. 

(d) The terms and the phrases used in the 
claims must find clear support or antecedent 
basis in the description so that the meaning 
of the terms in the claims may be 
ascertainable by reference to the 
description" . 



MPEP 2106 section V, subsection B, subsection 1 recites (with 
emphasis added) : 

The satisfaction of the enablement requirement does 
not satisfy the written description requirement. See In 
re Barker , 559 F.2d 588, 591, 194 USPQ 470, 472 (CCPA 
1977), cert, denied, Barker v. Parker , 434 U.S. 1064 
(1978) (a specification may be sufficient to enable one 
skilled in the art to make and use the invention, but 
still fail to comply with the written description 
requirement). See also In re DiLeone , 436 F.2d 1404, 
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1405, 168 USPQ 592, 593 (CCPA 1971). For the written 
description requirement, an applicant's specification 
must reasonably convey to those skilled in the art that 
the applicant was in possession of the claimed invention 
as of the date of invention. 



Section 2161 of the MPEP discusses the three separate 

requirements for a specification under 35 U.S.C. 112, first 

paragraph. This section is quoted as follows. 

The specification must include a written description of 
the invention, enablement , and best mode of carrying out 
the claimed invention . 

The first paragraph of 35 U.S.C. 112 provides: 

The specification shall contain a written 
description of the invention , and of the manner and 
process of making and using it , in such full, 
clear, concise, and exact terms as to enable any 
person skilled in the art to which it pertains, or 
with which it is most nearly connected, to make and 
use the same , and shall set forth the best mode 
contemplated by the inventor of carrying out his 
invention . (emphasis added) . 

This section of the statute requires that the 
specification include the following: 

(1) a written description of the invention; 

(2) the manner and process of making and using 
the invention (the enablement requirement) ; 
and 

(3) the best mode contemplated by the inventor 
of carrying out his invention. 

The three requirements are separate and distinct 
from each other. 

The written description requirement is separate and 
distinct from the enablement requirement. In re Barker, 
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559 F.2d 588, 194 USPQ 470 (CCPA 1977), cert, denied, 
434 U.S. 1064 (1978); Vas - Cath, Inc. v. Mahurkar, 935 
F.2d 1555, 19 USPQ2d 1111, 1115 (Fed. Cir. 1991) (While 
acknowledging that some of its cases concerning the 
written description requirement and the enablement 
requirement are confusing, the Federal Circuit reaffirmed 
that under 35 U.S.C. 112, first paragraph, the written 
description requirement is separate and distinct from the 
enablement requirement and gave an example thereof) . An 
invention may be described without the disclosure being 
enabling (e.g., a chemical compound for which there is no 
disclosed or apparent method of making) , and a disclosure 
could be enabling without describing the invention (e.g., 
a specification describing a method of making and using 
a paint composition made of functionally defined 
ingredients within broad ranges would be enabling for 
formulations falling within the description but would riot 
describe any specific formulation) . See In re 

Armbruster , 512 F.2d 676, 677, 185 USPQ 152, 153 (CCPA 
1975) ("[A] specification which ^describes' does not 
necessarily also ^enable' one skilled in the art to make 
or use the claimed invention."). Best mode is a separate 
and distinct requirement from the enablement requirement. 
In re Newton , 414 F.2d 1400, 163 USPQ 34 (CCPA 1969) 



Further, section 2163 of the MPEP provides additional guidance for 

the written description requirement and is quoted below (with 

emphasis added) . 

The written description requirement has several 
policy objectives. "[T]he ^essential goal' of the 
description of the invention requirement is to clearly 
convey the information that an applicant has invented the 
subject matter which is claimed." In re Barker , 559 
F.2d 588, 592 n.4, 194 USPQ 470, 473 n.4 (CCPA 1977), 
cert, denied , 434 U.S. 1064 (1978). Another objective is 
to put the public in possession of what the applicant 
claims as the invention so that the public may ascertain 
if the patent applicant claims anything that is in common 
use, or already known. Evans v. Eaton , 20 U.S. (7 
Wheat. ) 356 (1822) . 

An applicant's specification must convey with 
reasonable clarity to those skilled in the art that, as 
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of the filing date sought, he or she was in possession of 
the invention, i.e., whatever is now claimed . Vas - Cath 
Inc. v. Mahurkar , 935 F.2d 1555, 19 USPQ2d 1111, 1117 
(Fed. Cir. 1991) . The written description requirement 
prevents an applicant from claiming subject matter that 
was not described in the application as filed , and the 
proscription against the introduction of new matter in a 
patent application (35 U.S.C. 132 and 251) serves to 
prevent an applicant from adding to the informational 
content of a patent application after it is filed. 



Section 2163.02 of the MPEP proceeds to give a standard for 

determining compliance with the written description requirement and 

is quoted below (with emphasis added) . 

The courts have described the essential question to 
be addressed in a description requirement issue in a 
variety of ways. An objective standard for determining 
compliance with the written description requirement is, 
" does the description clearly allow persons of ordinary 
skill in the art to recognize that he or she invented 
what is claimed . " In re Gosteli , 872 F.2d 1008, 1012, 
10 USPQ2d 1614, 1618 (Fed. Cir. 1989). Under Vas - Cath, 
Inc. v. Mahurkar , 935 F.2d 1555, 19 USPQ2d 1111, 1117 
(Fed. Cir. 1991), to satisfy the written description 
requirement f an applicant must convey with reasonable 
clarity to those skilled in the art that, as of the 
filing date sought f he or she was in possession of the 
invention f and that the invention f in that context , is 
whatever is now claimed . The test for sufficiency of 
support in a parent application is whether the disclosure 
of the application relied upon "reasonably conveys to the 
artisan that the inventor had possession at that time of 
the later claimed subject matter. " Ralston Purina Co. v. 
Far - Mar - Co., Inc. , 772 F.2d 1570, 1575, 227 USPQ 
177, 179 (Fed. Cir. 1985) (quoting In re Kaslow , 707 
F.2d 1366, 1375, 217 USPQ 1089, 1096 (Fed. Cir. 1983)). 

Whenever the issue arises, the fundamental factual 
inquiry is whether a claim defines an invention that is 
clearly conveyed to those skilled in the art at the time 
the application was filed. The subject matter of the 
claim need not be described literally (i.e., using the 
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same terms or in haec verba ) in order for the disclosure 
to satisfy the description requirement. If a claim is 
amended to include subject matter, limitations, or 
terminology not present in the application as filed, 
involving a departure from, addition to, or deletion from 
the disclosure of the application as filed, the examiner 
should conclude that the claimed subject matter is not 
described in that application. This conclusion will 
result in the rejection of the claims affected under 35 
U.S.C. 112, first paragraph - description requirement, or 
denial of the benefit of the filing date of a previously 
filed application, as appropriate. 



With respect to the descriptive portion of the specification, 
applicant fails to describe the invention in such a fashion which 
would have been clearly conveyed to persons of ordinary skill in 
the art at the time the application was filed. The specification 
is replete with the use of terms like "can be", "may be used'', 
"could be used", "such as", "for example", etc. (without any 
accompanying specifics as to how they can be implemented) which 
clearly indicates a lack of possession. 

The absence of any positive statement of a preferred or even 
a single specific combination expresses a clear lack of certainty 
or failure to disclose that specific subject matter which comprises 
the invention . 

Extensive use of the above indicated terms further indicates 
that applicant is not, and was not, in possession of an inventive 
concept or best mode therefore, since the specification 
exhaustively lists numerous possible embodiments and combinations 
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thereof without any supporting specifics as to how the embodiments 
are implemented or function. 

All of the claims are directed to subject matter that is not 
adequately described in the specification. Specif ically, the image 
processing system, including temporal interpolation, weighting, 
scaling, and memory processing, that is recited in the claims is 
not adequately described in the specification so as "to reasonably 
convey to one skilled in the relevant art that the inventor (s), at 
the time the application was filed, had possession of the claimed 
invention" as required by 35 U.S.C. 112, first, paragraph. This is 
indicated by the underlined portions of the specification (in the 
attached Appendix) which correspond to the subject matter that is 
recited in the claims. 

Throughout the specification, applicant repeatedly presents 
general possibilities for implementations without any accompanying 
details. The following are a few brief - examples of applicant's use 
of this type of language. 

1) On page 454 of the specification applicant discloses what he 

terms a "Special Effects Application^, the whole of which is 

replicated below (with emphasis added) . 

A low cost special effects system can be used in a 
TV studio application, a business graphics application, 
and other applications . For example , special effects can 
be used to generate slides for business presentations and 
to generate graphic art images for advertisements . 
Although the final product of a graphic art system may be 
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static photographs, real time operation permits an 
operator to efficiently and rapidly configure images . 
Real time operation and interactivity enhances 
productivity . 



2) On page 466 of the specification applicant discloses what he 

terms a ^Flight Simulator Application^, the whole of which is 

replicated below (with emphasis added) . 

A flight simulator, such as an aircraft navigational 
simulator or bombing simulator , can be effectively 
implemented with the Videonic system . Ground terrain is 
simulated with digitized photographs. Occulting objects; 
such as tanks and trucks on the ground, lower flying 
aircraft, and smoke plumes : are generated with overlays. 
The overlays are independently manipulated to provide 
relative motion and 3D-perspective between overlays for 
realism. 



3) On page 494 of the specification applicant discuses robotic 

applications and indicates, in part (with emphasis added) : 

Visual guidance relates to a form of robotics for 
a robot that is free to move from a fixed position. 
The image processor discussed herein can provide such 
visual guidance . Such machines include guided 

weapons, satellites, aircraft, land vehicles, and even 
Star Wars R2D2 type robots. Guided weapons, such as 
cruise missiles and intelligent bombs , can be guided 
using mid-course and terminal visual guidance systems. 
Satellites can be positioned and oriented and spacecraft 
can be docked using visual control systems . Land vehicles 
can be guided using a visual guidance system; 
automatically following a roadway and detecting and 
circumventing obstacles. 



While these are only a few examples of the extensive and 
repeated usage of language that both indicates that applicant did 
not possess the invention when it was filed and that the claims are 
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not enabled by the originally filed specification, the 
specification is replete with such instances. The citation of each 
and every instance would nearly replicate the 575 page 
specification. Therefore, attached as "Appendix I" is a marked up 
reproduction of applicants originally filed specification. Each 
underlined sentence/section of the marked up copy is an instance of 
language that indicates that applicant did not possess the 
invention. Essentially, each of these instances would be followed 
with the question of "How?": "How is this implemented?" ; "How is 
this constructed?"; "How does this function?"; "How does this 
operate with other recited elements discussed?". At least each of 
these questions needs to be answered for each of the marked 
instances to satisfy the 112 requirements. Further, applicant 
needs to show where, in the originally filed specification , 
specifics for each of the various possibilities that are recited 
(in the specification) can be found. Currently, there are numerous 
possibilities mentioned in the specification but there are no 
specifics provided . Without these specifics, it is clear that 
applicant did not have possession of the claimed invention or the 
material mentioned in the specification, but simply had some things 
that might be able to be done, but no specifics to implement these 
possibilities . 
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17. The disclosure is objected to because of the following 
informalities : 

On page 97 of the specification, lines 8-12, the recitation 
indicates that "[W]hen a line sync pulse is detected in element 
210H, operation branches along the NO path to element 2101". 
However, the drawings (Fig. 2H) indicate that this branch is taken 
when NO line sync is detected and that the branch to element 210J 
is taken when a line sync pulse IS detected. 

On page 170 of the specification, the last line is cut off and 
is incomplete. The exact meaning of this section of text can not 
be fully comprehended because of this. 

Starting on page 404 of the specification there is discussion 
of a Fig. 8A. However, there is no such Figure, nor is there any 
of the numbered elements that are recited in this section . 
Similarly, on starting of page 482 of the specification, there is 
discussion of a Figure 11B. Again, there is no such Figure. 
Further, starting on page 483 reference is made to a Fig. 9B and 
associated elements . Once again, there is no such Figure. 
Additionally, there is no mention of any of these Figures in the 
Brief Description of the Drawings in the specification. It is 
noted that these are the only mentions of these Figures. 

Appropriate correction is required. Applicant is reminded 
that in correcting these problems, no new matter may be added to 
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the specification or drawings. 

18. The drawings are objected to because while the specification 
makes reference to Figures 8A, 9B, and 11B none of these Figures 
actually appear in the drawings. Further, these numberings appear 
to be erroneous as there are no Figures 9A, 10, or 11A, which are 
at least suggested to exist by the reference to alleged Figures 
8A, 9B, and 11B (nor is there any mention of a Fig. 9A, 10, or 
11A) . There can not be a Figure 9B without a Figure 9A. 
Similarly, there can not be a Figure 11B without a Figure 10 or a 
Figure 11A. Correction is required. Again, it is noted that these 
are the only mentions of these Figures. Again, applicant is 
reminded that in correcting these problems, no new matter may be 
added to the specification or drawings . 

Claim Rejections - 35 U.S.C. § 103 

19. The following is a quotation of 35 U.S.C. 103(a) which forms 
the basis for all obviousness rejections set forth in this Office 
action: 

(a) A patent may not be obtained though the invention is not identically 
disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art 
to which said subject matter pertains. Patentability shall not be negatived 
by the manner in which the invention was made. 

20. Claims 95-97 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Marsh (US. 4,179, 824) and Golin 
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et al. (US. 4,868,653) . 

Regarding claims 95-97, Marsh discloses an image processor 
coupled to the memory accessing circuit and generating a rotated 
and translated image by rotation and translation processing of the 
digital image information accessed by the memory accessing circuit 
(Figure 1, elements 60, 60C, 62, 63, 64 and 65, and 48, figure 3, 
elements 304 and 306) , a projection display medium coupled to the 
image processor and displaying an image in response to the rotated 
and translated image generated by the image processor (Figure 1, 
element 44) . 

However, Marsh is silent about the specific details regarding 
a read-only memory storing image information. In the same field of 
endeavor, however, Golin discloses a ROM memory and loading circuit 
(Figure 1, elements 18, 20, and 24) for storing and loading digital 
image information. Therefore, it would have been obvious to one 
having ordinarily skill in the art to use ROM memory and loading 
circuit as taught by Golin because it provides an input source for 
a compressed digital video signa representative of a full motion 
color video signal which is suitable for recording or transmission 
using relatively narrow band media and which may be decompressed at 
speeds at least equal to conventional video frame rates. 
21. Claims 98-379 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Marsh (US. 4,179,824) and Golin 
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et al. (US. 4, 868, 653) , as applied to claims 95-97, above, and 
further in view of Nickel (US. 3,905,045), Widergreen (US. 
4,302,775) and Robinson (US. 4,213,150). 

As to claims 98-170, 282-294 and 301, Marsh disclose a system 
comprising : 

a database memory (figure 1, element 48), an image memory 
(figure 3, elements 304, 306), an accessing circuit for accessing 
the image from the memory (figure 1, processor control logic 70), 
a processor (figure 1, elements 60, 62, 63, 64, 65 and 72 and more 
specifically in subsequent figures) for processing the image stored 
in the memory, where the processor performs the following 
processes; translation, rotation scaling, compression, expansion, 
texture, topography, map, roll, pitch, occulting, perspective and 
3D image production, which are transformed images and display to 
display the processed image (figure 1, element 82) , scaling 
controller (figure 1, element 60C) , processing and producing images 
at various resolutions (column 1, lines 6-14, 31-51; column 2, line 
21 to column 3, line 41; column 3, lines 1-19, 26-31; column 4, 
line 21 to column 5, line 52). 

Additionally, Marsh discloses a communication link coupled to 
the data base memory and a remote location flight simulator 
computer (figure 1, element 16), an input circuit (figure 1, element 
40) generating first and second channel of input image information, 
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an accessing circuit coupled to the memory, and accessing the image 
from the memory (figure 1, element 40) . 

Marsh is silent about interpolation processor, and transform 
processor, and input circuit as claimed, interpolation processors, 
transform processors and input circuits are all well known in the 
art of image processing as shown by Nickel (Figure 4, element 78, 
50 , 52 ; figure 8 , column 3, line 64 through column 4 , line 52 ; 
column 9, line 46 through column 10, line 20) . Interpolation 
process inherent ly includes _sub pixe l interpolation and temporal 
interpolation. 



Therefore, it would have been to one of the ordinary skill in 
the art to include interpolation process, transform processor and 
input circuit shown by Nickel in the object simulation system of 
Marsh because ^these procedures^ jare very conventional in nearly all 
image processing systems. 

Additionally, the combination of Marsh, Golin, and Nickel are 
silent about compression and decompression circuit and color 
display. However, compression and decompression circuits and color 
display are well known in the image processing art as being 
disclosed by Widergren in a digital video compression system for 
compressing the digitized video signals in real time at rates up to 
NTSC color broadcast (abstract, lines 1-15) comprising adaptive 
scene coding and decoding compressor (figure 1, element 10), coding 
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and decoding circuits compress and decompress image data to produce 
reduced redundant image and reduced spatial frequency image and 
bandwidth which are reconstructed and restored during decompression 
process. Additionally Widergren discloses color image processing 
(abstract, lines 1-10) . Therefore, it would have been obvious to 
one having ordinary skill in the art at the time of the invention 
to use image coding and color image processing as taught by 
Widergreen in the system of Marsh because such processes are 
conventionally well known in the image processing art. 

Further, the combination of Marsh, Golin, Nickel and Widergren 
are silent about we ighing circuit and kernel circuits. However, 
weighing and kernel circuits are conventional and well known in the 
image processing art as being disclosed by Robinson (column 1, 
lines 22-40 and figure 1, elements 11 and 17) . Therefore, it would 
have been obvious to one having ordinary skill in the art at the 
time of the invention to use weighing circuit as taught by Robinson 
in the system of Marsh because such processes are conventionally 
well known in the image processing art. 

22. As to claims 171-281, 295-300, and 302-379, these claims 
recite process steps that are nothing more than a restating of the 
functions of the specific components of the apparatus as claimed 
above and, therefore, it would have been obvious to perform the 
recited steps considering the aforementioned rejection for the 
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apparatus claims 95-170, 282-294 and 301. 

Claim Rejections - 35 U.S.C. § 101 

23. Claims 95-97 are rejected under the judicially created 
doctrine of obviousness-type double Patenting as being unpatentable 
over claim 8 of U.S. Patent No. 4, 491, 930 in view of the 
combination of Marsh (USP 4, 179, 824) and Golin et al. (US. 
4, 868, 653) . 

24. With respect to the pending claims, claim 8 of the '930 Patent 
differs in that it recites a signature signal rather than an image, 
recites a digital input means but not the accessing circuit claimed 
in the application, and does not include the specific processing 
claimed in the application. As to the first point, it is clear 
that the term signal claimed in the Patent encompass image signals 
(see column 263, lines 26-30 of the '930 Patent) . As to the second 
point, the inclusion or exclusion of input and memory access 
circuitry does not patentably distinguish the claims as such means 
would be recognized by one skilled in the art as necessary and 
in^^ whether they 
are explicitly claimed or not (for example, the means for 
generating a memory output signal in the '930 Patent must include 
some means of accessing the memory in order to function as 
claimed) . With respect to the specific processing, these functions 
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are well-known types of processing (i.e., filtering) as taught by 
Marsh and Golin. It would have been obvious to one skilled in the 
art to interpret the filter means of the '930 Patent as including 
such operations-- particularly in view of the statements at column 
6, lines 18-25 and 36-53 of the x 930 Patent that broadly define the 
filter means as encompassing many types of digital filtering or 
signal processing. Note that the specification of the x 930 Patent 
is being used in this case only as a dictionary for interpreting 
the claim language. In re Boylan, 392 F.2d 1017, 157 USPQ 370 
(CCPA 1968) . 

25. Refer to the art rejection of claims 95-97, under 35 U.S.C. 
103 above, the statements of which are incorporated herein. 

26. Claims 98-379 are rejected under the judicially created 
doctrine of obviousness-type double Patenting as being unpatentable 
over claim 8 of U.S. Patent No. 4, 491, 930 in view of the 
combination of Marsh(US. 4,179,824) and Golin et al. (US. 
4,868,653), as applied to claims 95-97, above, and further in view 
of Nickel (US. 3,905,045), Widergreen (US. 4,302,775) and Robinson 
(US. 4,213,150) . 

27. Refer to the art rejection of claims 98-379, under 35 U.S.C. 
103 above, the statements of which are incorporated herein. 

28. While it is true that the Examiner has the burden to show how 
a rejection is specifically applied to each claim, the exemplary 
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showing with respect to the claims individually discussed above is 
enough to give the applicant fair notice of how the rejection is 
applied to each and every other claim. The above paragraphs 
establish a prima facie showing of the unpatentability of the 
instant claims and the burden shifts to the applicant to show, if 
he can, patentable distinctions between the instant claims and 
those of the patents. 

29. Any inquiry concerning this communication or earlier 
communications from the examiner should be directed to Joseph 
Mancuso whose telephone number is (703) 305-3885. The examiner can 
normally be reached on Monday-Friday from 8 : 30AM-5 : 00PM. 

If attempts to reach the examiner by telephone are 
unsuccessful, the examiner's supervisor, Amelia Au, can be reached 
on (703) 308-6604. The fax phone number for this Group is (703) 
308-5397. 

Any inquiry of a general nature or relating to the status of 
this application or proceeding should be directed to the Group 
receptionist whose telephone number is (703)305-857^5?. 



JM 

September 23, 1998 
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************************************************************ 

IMPORTANT NOTICE 



********************************** 

Effective November 16, 1997, the Examiner handling this 
application will be assigned to a new Art Unit as a result of the 
consolidation into Technology Center 2700. See the forth coming 
Official Gazette notice dated November 11, 1997. For any written or 
facsimile communication submitted ON OR AFTER November 16,1997, 
this Examiner, who was assigned to Art Unit _2616_, will be 
assigned to Art Unit _2723_. Please include the new Art Unit in the 
caption or heading of any communication submitted after the 
November 16,1997 date. Your cooperation in this matter will assist 
in the timely processing of the submission and is appreciated by 
the Office. 



APPENDIX 1 



CROSS-REFERENCE TO RELATED APPLICATIONS ^. ^ 

This application is a continuing application continuing from application 
IMPROVED ARCHITECTURE S/N 07/289, 355 filed on December 22,. 1988 now pending; 
where this parent application S/N 07/289,355 is a continuing application 
continuing from parent: application IMPROVED IMAGE PROCESSING ARCHITECTURE S/N 
06/663,094 filed on October 19, 1984 where this parent application S/N 
06/663,094 is a continuation in part of two patent applications: i 1 
IMPROVED MEMORY ARCHITECTURE HAVING MULTI-DIMENSIONAL ADDRESSING by Gilbert 
P. Hyatt Serial No. 06/661,649 filed on October 17, 1984 and 

2. IMPROVED MEMORY ARCHITECTURE HAVING A MULTIPLE BUFFER OUTPUT 
ARRANGEMENT by Gilbert P. Hyatt Serial No. 06/662,211 filed on October 18, 
1984; 

'where the benefit of the filing dates of all of the above ancestor 
applications is claimed in accordance with 35 USC 120 and other authorities 
therefor and where ancestor applications Serial No. 06/661,649; Serial No. 
06/662,211; and Serial No. 06/663,094 are herein incorporated by reference. 

2 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The field of the present invention is display and machine vision systems 
and, in particular, image processing systems. 

PRIOR ART , , . 

The prior art in display systems includes graphic systems, image 
processing systems, and many other types. These systems are typically large, 
expensive, and do not operate in real time. Compact avionic packaging does 
provide small systems. Real time display systems are available in the 
graphics market, such as the CT-5 from Evans and Southerland, and m the 
image processing market in the form of broadcast systems, such as the Mirage 
from MCI Quant el, and in the form of moving map display . systems, such as 
from Bendix and Harris. 

3 

SUMMARY OF THE INVENTION 

The present invention is generally directed to improved processing 
systems and, in particular, provides improvements in memory, processor, 
software, and control architectures and in sottware and hardware designs . A 
system architecture is provided that provides flexibility, performance, and 
efficiency . A geometric processor is provided that implements rotation, 
translation, expansion, " compression, ~ warping, 3D-perspective, vector 
generation, and other features in a high pertormance and efficient manner!, 
such as by using a window implementation and by providing the flexibility of 
software 'control . A spatial processor is provided that "provides smoothing, 
anti-aliasing, ~and other features . Memory architectures and designs are 
provided that increase performance and efficiency, including a memory map and 
a buffer memory . Programs are provided that enhance" flexibility and 
capability, yet preserve the high performance of the hardware. For exampleT 
efficient"^ geometric initial " condition generation and time domain 
interpolation enhance performance. Many other novel and valuable features 
are disclosedT : 

4 

BRIEF DESCRIPTION OF THE DRAWINGS 

A better understanding of the present invention may be obtained from a 
consideration of the detailed description hereinafter taken in conjunction 
with the drawings, which are briefly described below. 

Fig 1, comprising Figs 1A to IP, provides block diagrams of various 
configurations of the present invention together with various flow diagrams 
and image diagrams; where Fig 1A is a block diagram representation of one 
configuration of the system of the present invention; Fig IB is a block 
diagram of a geometric module configuration; Fig IC is a block diagram of a 
single channel configuration of one configuration of the present invention in 
accordance with a reduced implementation of Fig IA; Fig ID is a block diagram 
of a geometric processor module in accordance with Fig 1A; Fig IE is a block 
diagram of a spatial processor module in accordance with Fig IA; Fig IF is a 
block diagram of input sources, input interfaces, and input 
multiplexers/demultiplexers in accordance with Fig IA; Fig 1G is a block 
diagram. of an output interface, output multiplexers/demultiplexers, and 
output devices in accordance with Fig IA; Fig lH is a block diagram of an 
alternate configuration, of the system of the present invention as 

implemented in an experimental system; Fig II is a block diagram of another 
alternate configuration of the system of the present invention; Fig 1J is a 
block diagram of still another configuration of the system of the present 
invention; Fig IK is an image processing window arrangement; Fig IL is a 
block diagram of still another configuration of the system of the present 
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invention; Fig 1M is an image diagram showing .geometric processing; Fig IN. is 
an image diagram showing image translation; .Tig 10 is a flow diagram showing 
operation of one geometric processor configuration; and Fig IF is another 
block diagram representation of an arrangement for implementing the system of 
the present invention . . 

Fig 2, comprising Figs 2A to 2M, describes an, image processor 
configuration with window diagrams, flow diagrams, and logic diagrams; where 
Fig 2A is a diagram of the memory hierarchy associated with .window 
processing; Fig 2B is a diagram of window processing m accordance. with Fig 
2A; Fig 2c is one configuration of a window diagram showing rotation about 
the window center; Fig 2D is a configuration of a window diagram showing 
rotation about an offset from the window center; Fig 2E is another 
configuration of a window diagram showing rotation about the window center; 
Fiq 2F is a configuration of a window diagram showing rotation about an 
offset from the window center; Fig 2G is Still another configuration of a 
window diagram showing rotation about the window center; Fig 2H is a. flow 
diagram snowing geometric processing in accordance with the window 
arrangement of Fig 2G; Fig 21 is a schematic and block diagram representation 
of address generators for providing geometric processing; Fig 2 J is, a 
diagramatic representation of expansion processing; Fig 2K is a diagramatic 
representation of compression processing; Fig 2L is a diagramatic 
representation of address generator scaling; Fig 2M is a block .diagram 
representation of an arrangement for implementing the addressing and 
architecture of the memory or the 
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present invention. 

Fig 3, comprising Figs 3A to 3C, showing image memory operations. 

Fig 4, comprising Figs 4A to 4B, is a diagramatic representation of 
address generators; where Fig 4A is a diagram of an address generator 
partitioned into an X-address component and a Y-address component and Fig 
4B is a diagram of an address generator concatenating an X-address 
component and a Y-address component. 

Fig 5, comprises Figs 5A to 5D: where Fig 5A is a block diagram 
representation of a spatial filter arrangement; Fig 5B is a block diagram 
representation of a sum-of-the-products arrangement that can be used with 
the arrangement of Fig 5A; Fig 5C is a block diagram of a 3-channel 
sum-of-the-products arrangement; and Fig 5D is a "clock diagram of a 
multiple channel buffer memory, . . , . , 

Fig 6, comprises Figs 6A to 6 AH: where Fig 6A is a block diagram 
representation or a system configuration for implementation of the present 
invention; Fig 6B is a detailed schematic diagram of clock steering logic- 
Fig 6C is a detailed schematic diagram of clock gating logic; Fig 6D is a 
detailed schematic diagram of control logic; Fig 6E is a Block diagram of 
a configuration for implementing the memory of the present invention; Fig 
6F is a detailed schematic representation of logic for addressing and 
scanning-out memory information in accordance with the the memory of Fig 
6E; Figs 6G to 6J are detailed block diagram representations in accordance 
with the memory of Fig 6E; Figs 6K to 6N are detailed schematic diagram 
representations in 
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accordance with the memory of Figs 6F and Figs 6G to 6J; Figs 60 and 6P are 
detailed schematic diagram representations of one configuration of an address 
generator that can be used in the system of the present invention; Figs 6Q 
and 6R are detailed schematic diagram representations of another 
configuration of an address generator that can be used in the system. of the 
present invention; Fig 6S is a detailed schematic diagram representation of 
a video DAC channel; Fig 6T is a detailed schematic diagram representation 
of a video synchronization pulse generator and clock pulse generator; Fig 6U 
is a detailed schematic diagram representation of joystick interface logic; 
Fig 6V is a detailed schematic diagram representation of joystick analog to 
digital converters; Fig 6W is a detailed schematic diagram representation of 
an address counter arrangement for loading a multiple buffer memory and 
related logic; Fig 6X is a detailed schematic diagram representation of an 
address counter arrangement for unloading a multiple buffer memory and 
related logic; Fig 6Y is a detailed schematic diagram representation of a 
first channel address multiplexer and RAM arrangement for a multiple channel 
buffer memory; Fig 6Z is a detailed schematic diagram representation of a 
first channel RAM input/output multiplexer arrangement for a multiple channel 
buffer memory; Fig 6AA is a detailed schematic diagram representation of a 
second channel address multiplexer and RAM arrangement for a multiple channel 
buffer memory; Fig 6AB is a detailed schematic diagram representation of a 
second channel RAM input/output multiplexer arrangement for a multiple 
channel buffer memory; Fig 6AC is a detailed schematic diagram 
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representation of a third channel address multiplexer and RAM arrangement for 
a multiple channel buffer memory; Fig 6 AD is a detailed schematic diagram 
representation of a third channel RAM, input/output multiplexer arrangement 
for a multiple channel buffer memory; Fig 5AE is a detailed schematic diagram 
representation of a forth channel address multiplexer and RAM arrangement for 
a multiple channel buffer memory; Fig 6AF is a detailed schematic diagram 
representation of a forth channel RAM input/output multiplexer arrangement 
for a multiple channel buffer memory; Fig BAG is a detailed schematic diagram 
representation of a 9-pixel kernel register arrangement for spatial 
processing; and Fig 6 AH is a detailed schematic diagram representation of 
a weight RAM arrangement for spatial processing. ,,,, , 

Fig 7, comprising Figs IK to 7D, show database memory and i filtering 
configurations; where Figs 7A to 7C show mosaic arrangements and Fig 7D is 
a detailed flow diagram representation of the BASIC PROGRAM LISTING FTR. ASC 
for filtering images. _ ^ > * 

Fig 8 is a block diagram representation showing one . configuration of 
a system for processing large database images. Fig 9 is a block diagram 
representation showing another configuration of a system for processing 
lar.ge database images. 

9 

To facilitate disclosure of the illustrated embodiments, the components shown 
in Figs I to 9 of the drawings have been assigned reference numerals and a 
description of such components is given in the following detailed 
description. The components in the figures have in general been assigned 
reference numerals, where the hundreds digit of each reference numerals 
corresponds to the figure number. For example, the components in Fig 1 had 
reference numerals between 100 and 199 and the components m Figure 2 have 
reference numerals between 200 and 299, except that a component appearing in 
successive drawing figures has maintained the first reference numeral. 
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General . , 

One configuration of the system of the present invention is an image 
processing system capable of geometrically manipulating a highly detailed 
image in true real time; such" as tor simultaneous rotation, " translation," 
expansion, compression, 3D perspective, and warping at a jU-times per second 
update r ate. .Other capabilities include image enhancement, smoothing, and 
image filtering; all in real time. The image can be obtained from a wide 



variety of sources: such as from a video camera or from a database memory. 

The image processor can be impl emented in a range of configurations, 
including an image processing subsystem and an image processing system . One 
configuration is a multiple channel" high resolution image processor . Various 
modules are discussed to accommodate different types of input and output 
interfaces and multiple channel capability. The various modules of the image 
processor permit implementation of a basic configuration and then permit 
modular expansion to a multi-channel system . Modularity permits the" basic 
configuration to be implemented in multitudes of ways using such modules . 

Thfi hasir. configuration with its modular flexibility can be configured 
into a sophisticated system with extensi ve capabilities, such as a turn-key 

rkstation that can be configured for v" J --- 
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novsticks, or trackball . This configuration 
purpose image processing workstation, cor ' 
business graphics workstation, computer ai 




_ configuration is shown in Figs IA to IG and summarized in the MODULAR 
CONFIGURATION FEATURES TABLE herein. Various other configurations can also be 
provided . The block diagram shown in Fig IA illustrates the modular 
expendability of the system of the present invention, shown in greater detail 
in Figs IB to 1G. A plurality or geometric modules 110A to HOB can be 
configured in parallel channel form, such as for multiple overlays . The 
' ' " 1 ' e combined with a geometric 

lultiplexing selects a particular 




geometric processed image channel tor subsequent processing. Processing 

includes overlaying, ad ding, subtracting, and otherwise selecting and 

ing pi images ". For example, many channels of 

images 




images can be selected for arithmetic processing , such as , for adding 

together T TKe processed and combined images ran be demul tiplexed with 
ellment HOD to route the appropriate images to the appropriate spatial 
modules 110E to 110F and for feedback to the geometric modules along path 
IIOH. The spatial modules HOG can 
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modules HOC. Output devices 110K can be exc ited with images that axe 
processed with the output image interfaces HOP and output 
multiplexer/demultiplexer IIOQ. Multiplexer/demultiplexer modules HOD, HON, 
and 110Q can be implemented to multiplex a plura lity of channels into one 
channel and then to demultiplex that one " channel into a plurality of 
channels^ Each multiplexer associated with a channel can be "replicated a 
plurality of times to multiplex a plurality of channels into each single 
channel . The multiplex signals associated with the plurality ot multiplexed 

channels can then be demultiplexed, permittin g routing of any one of a 

plurality of multiplexer input channels to any one of a plurality of 



;rs are well-known 
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A supervisory processor 110R provides supervisory operations; such as 
receiving external commands JJOS for configuring the system . For example, 
geometric modules HOC can be controlled for different types of geometric 
processing with different geometric parameters; spatial modules HOG can be 
controlled for different types of weights loaded "into weight RAMS; and the 
multiplexer/demultiplexer modules and combiner module 1101, 11UN, and 1100 
can be selected for multiplexing and demultiplexing of images. 

The arrangement shown in Fig IB represents" one arrangement tor modulely 
expanding the system of the present invention. However, the system of the 
present invention can be implemented in various subsets of this configuration 
and various modifications to this conf lguratidru For example, one "reduced 
configuration for geometric processing provides a geometric module 110A by 
itself, as shown in" Fig IB. For example", geometric module IIOA can be used "as 
a sub-system for other systems without "the other modules shown in Fig 1A. 
Alternately, the system can be implemented as a single channel system as 
shown in Fig IC . An image source 111A, such as a Winchester disk or floppy 
disk , can be "used to provide images which can be processed with the input 
image interface 111B, such as for "multiplexing and "loa ded into image memory 
111C . Geometric processor HOP operates under" control of channel processor 
111E to generate geometrically processed images from image memory 111C. 
Spatial processor 110F spatial"! y" processes , the information from geometric 
processo r HOD to provide "a spatially geqmetric processed im^ge to the output 
image interface 1I1F. The output image interface IIIF can 
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_ z _e channel combinatio: 

of the more general, version ghown in, fig IA. . ^ n 

One configuration of the geometric module 111H is shown m block diagram 
form in Fig ID. Image memory IllC receives image information from the input 
image interface for outputting to the spatial processor and to the output 
image interface under control of geometric processor HID. Geometric 
processor HID can rotate/ translate, expand, compress, 3D process, warp, and 
otherwise geometrically process the image stored in image memory iiic TEo 
provide the' geometrically processed output image. Geometric processor 111C 
operates under control of channel processor "HID for generating initial 
condition information, such as under control of once per field or once per 
frame initial condition information. Channel processor HIE in turn operates 
under control-of supervisory processor 110R, such as for communication of 
commanded motion from operator controls or from a host-computer" 

One configuration of spatial module HOE is shown m block diagram form 
in Fig IE. It provides spatial processing of image information. In one 
conf igurationj i mage information is geometrically processed and loaded into 
a buffer memory, such as a multiple buffered 3- line Suffer memory . The 3-line 
buffers load Tcernel registers HU tor parallel generation of a 9-pixel 



kernel. A weight RAM 111M is loaded with weights from the 
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supervisory processor for the desired spatial processing . Multipliers 111K 
and summers II 1L multiply the appropriate weights trom weight RAM 111M with 
the corresponding intensities from kernel registers 111J to obtain weighted 
intensities and sum these weighted intensities to get a single weighted 
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Composite video signals 112P can be ^ multiplexed with 
multiplexer /demultiplexer 112V and converted fb analog RGB signals 1120 with 
converters 112T to 112U, which can then be processed with the "RGB video ADCs 
112M and 112N for conversion to digital RGB image information 112H. The 
analog RGB signals can be multipiexed "with multiplexer 112R for time sharing 




c ame r a s 

Digital image information can be provided to the g eometric modules, such 
as for storing in image memory, or " can he routed to other devices. For 
example, a digital frame buffer 112S can be provided for buffering input 
image information, such as in a double buffer arrangement, to reduce 
contention with image memory operations . 



. L r- . t )ut 

devices llJG td 113L under control of "the supervisory processor. Digitally 
processed image information can be routed d irectly to digital devices 113K to 
113L, such as a pattern recognition processor "or artificial intelligence 
processor or a digital dat abase memory. Digitally processed image information 
can also be routed to analog^ devices "113G "to 113J through RGB video 
digital-to-analog converters" (DACs) . RGB video signals can be" converted to 
composite video signals with converters 113E to 113T tor output devices that 
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operate on composite signals 1131 to 113J. Output devices that operate on 
RGB video and composite video signals include video tape recorders, video 
monitors, and other video output devices. Alternately, video output signals, 
digital or analog, can be fed- back to the input interface for recirculating 

through the image processor . 

Video DACs 11 3B to 113C and RGB-to-composite converters 113E and 113F 
can be dedicated to output channels or can be multiplexed with multiplexers 
113A and 113D respectively between a plurality of output channels under 
control of the supervisory processor. Auxiliary circuitry, such as a 

synchronization generator 113M and a blanking generator T13N, can be 

provided ; such as" for interfacing to a CRT monitor. 
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MODULAR CONFIGURATION FEATURES TABLE Supervisory processor A. 

CPU B. ROM C. RAM D. Input /output E. External commands 1. Joystick a. 
Rotation b. Translation C. Expand/compress d. Range (perspective) 2. 
Digital word, supervisory processor or keyboard a. Rotation 1) Each overlay 
ana background b. Translation 1) Each overlay and background C. 
Expand/compress 1) Each overlay and background d. occulting priorities 1) 
Each overlay e. ALU processing 1) Pair, overlays and/or background f. 
Wrap-around coordinates 

024 

MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) Video input 
interface A. Supervisory processor control B. Input multiplexer 1. Digital 



RGB a. Geometric processed feedback b. ALU processed feedback c. Spatial 
processed feedback d. Digital image source 1) Winchester disk 2) External 
computer a) VAX bus interface b) Multi-bus interface 2. Analog composite 
video a. Source 1) Video disk 2) Video tape • 3) Video sensor a) Vidicon 
b) Orthocon c) Infrared d) Radar e) Sonar b.. Converter, composite video 
to RGB video c. Converter, RGB video to digital, RGB 3. Analog RGB or 
monochrome video a. Source 1) Video sensor a) vidicon b) Orthocon c)- 
Infrared d) Radar e) Sonar b. Converter, RGB video, to digital RGB C. Input 
demultiplexer 1. Supervisory processor control 2. Distribution to geometric 
modules 3. Frame buffer a. Low speed input buffer b. Higher speed double 
buffer 
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MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) Geometric module 
A. Channel processor 1. Intel 8085 CPU 2. Rom; 16K, expandable 3. RAM; 4K, 
expandable 4. Input/output; 3 ports, expandable 5* Software a. Pascal 
compiled code b. Assembly language routines B. Geometric processor 1. 
Rotation a. Continuous b. Resolution; 0.02 degrees C. Range: unlimited, no 
hard stop 2. Compression a. Continuous b. Fractional (non-integer) . C.- 
Resolution: 1-pixel d. Range: 64-times to 'hard stop e. Progressive 
compression 2) Buffer image memory 3. Expansion a. Continuous b. Fractional 
Tnon-integer) c. Resolution: I -pixel a. Range: 512 times to "hard stop" 4. 
Translation a. Continuous b. Resolution 1-pixel c. Range: Unlimited d. 
Hard stop consistent with database image e. plus/minus X f. plus/ minus t Y 5. 
3D-Perspective a. Range variable compression b. Range variable intensity c. 
Range variable motion 6. warping 7. Mirror image a. X-image reversal b. 
Y-image reversal 
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MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) 

III. (Continued) C. Image memory 1. 512-by-512 pixels/block a. Expandable 
in blocks b. Maximum configuration: 4096-by-4096 pixels 2., Input and output 

a. Raster scan: 30 frames/sec max 1) 13-million pixels/sec max b. Random 
access: 13-million pixels/sec max C. Sequential access, along a vector 1) 
Start address 2) Pixel words d. Memory to memory transfers e. Processed 
image to memory 3. Pixel latitude a. DAC configuration is a function of 
option b. Pixel byte: 8-bits per pixel, expandable c. Color: RGB 1) Bits per 
pixel: T (where A+B+C=T, with jumper! a) Red: A b) Green: B c) Blue: C d. 
Color 19okup table 1) input bits per pixel (table input) : 8, expandable 2) 
Output Bits per pixel (table output) : 8, expandable 3) Pallet: ROM or S/w 
load of RAM e. Monochrome 4) Bits per pixel: 8 f . Expandable in 8-bit per 
pixel bytes 1) maximum configuration: 24"-bits per pixel 
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MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) 

IV. Geometric multiplexer/demultiplexer/combiner A. Supervisory processor 
control B. multiplexer 1. Digital RGB a.. Geometric processed pipeline C. 
Combiner 1. overlays a. overlay all geometric channels b. Occulting 1) 
Pixel-by-pixel occulting 2) Priority a) Host, computer control 3) Cropping a) 
Irregular external outline b) Irregular internal features c. Keying D. 
Arithmetic logic unit (ALU) 1. Select two geometric channels 2. Arithmetic a. 
Add images b. Subtract images C. Multiple images 3. Logically process images 
E. Demultiplexer 1. Digital RGB a. Distribution to spatial processor modules 
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MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) 
v. Spatial module A. Parallel channels B. Pipeline processor 1. Buffer memory 
2. Kernel registers a. Intensities b. 9-pixel kernel, expandable to 25-pixel 
kernel 3. Weights a. RAM 1) Host computer load b. ROM 4. Multipliers a. 
Parallel multipliers b. Intensity times weight 5. Summers a. Parallel adders 

b. Sum of the products C. Progressive compression D. Pre-f iltering 1* 
Feedback to input mux/demux 2. Low pass filter 3, Anti-aliasing E. 
Post-filtering r. Pipelined 2. Spatial resolution enhancement 3. Intensity 
resolution enhancement a. Processing gain b. Interpolation 4. Subpixel motion 
enhancement 5. Anti-aliasing 
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MODULAR CONFIGURATION FEATURES TABLE (CONTINUED) 
VI. Video output interface A. Supervisory processor control B. Spatial 
multiplexer 1. Digital RGB 2. Multiplexer multiple spatial channels C. 
Spatial demultiplexer 1. Digital RGB 2. Demultiplexes multiple output 
channels 3. Digital devices a. Winchester disk b. Pattern recognition system 

c. Artificial intelligence system d. External digital keyer 4. RGB video 
devices a. RGB video DACs b. CRT monitor c. External RGB video keyer 5. 
Composite video devices a. Video cassette recorder b. CRT monitor C. External 



composite keyer d. RGB video DACs e. RGB to composite video converter 
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Experimental System , _ i ^ ^_ _ ^ 

An experimental system has been configured to demonstrate many or the 
features of the present invention. One configuration of this experimental 
system will now be discussed with reference to Fig 1H. Image memory 120D is 
used to store an image. The image is procesr " 3 ~ *~ 
processor 120E and scanned out for df 1 - 
translate, rotate, compress 
processed image is scanne; 
analog converter (DAC) I; 

timing and control signals; sucn as cjlqck signals, norizoniai s yncnrunizdiiun 
signals, and vertical synchronization signals ; for control of system 
operations. The supervisory processor in mainframe 120B provides an interface 
to database memory 120A to load images into image memory 120D. Supervisory 
processor 1201 also controls operation of geometric processor 120E; such as 
by generating initial conditions to define translations.! positio n and 



im. Disk memory 120A is implemented with dual floppy d 
is implemented" as an S100 bus mainframe having an "8U85 



microprocessor 
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database memory and mainframe 12 OB simulates a database memory interface . As 
an alternate to direct scanout from geometric processor 1"2 0E, a refresh 



?rocessor 
can be 
tal pixel 



ipmetric _ processor 12 0E can generate digital pixel 
"to DAC 12QG tor refreshing of display monitor 120H. 
Ts 120K can include controls for " X -translation, 
Y- translation, compression/ expansion, and rotation , These controls can be 

- l it, ways; such as with switches, — " 



information directly 
Operator contro 

r w nslation, compre — ^ --■tltj- .^-ir - x - 

implemented in different wavs ; such as with s witches, potentiometers, 

encoders, and other input devices . For convenience of implementation,, a pair 
ot -joysticks, each having two axis of control, were selected. One joystick 
implements control of X -"translation and Y-translation . The other noystick 
implements control of rotation and compression/expansion . Operator controls' 
12UK are interrogated by the supervisory processor operating under program 
control and scenario parameters" are updated by the " supervisory processor 
operating under program control in " response to the operator" control 
conditions for initializing geometric processor 120E. 

Some of the more important features of the experimental system are 
listed in the EXPERIMENTAL CONFIGURATION FEATURES TABLE. 
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EXPERIMENTAL CONFIGURATION FEATURES TABLE Real time operation Medium 
resolution (260,000-pixels per frame) Dynamic updates at the field rate 
(60-times per second) Interactive operation Joysticks and computer commands 
X-axis translation Y-axis translation Rotation Expansion and compression 
Instantaneous response Simultaneous motion, all controls Geometric processing 
Rotation Continuous Resolution: 0.2-degrees 360-degrees/sec max rate Software 
limited Expandable Translation Continuous Resolution: 1-pixel 
1000-pixels/second max rate Software limited Expandable Expansion/compression 
Continuous Fractional (non-integer) Resolution: I -pixel Double/half size per 
second max rate Software stops Expandable Monitor Barco color monitor. 
Blanked to 484-lines and about 700-pixels/line 3-colors, RGB 13-inch CRT 
Inline gun shadow mask Image memory 512-pixels by 512-pixels 7-bits per pixel 
2-bits red 2-bits blue 3-TDits green 200-ns RAMs Spatial filtering 9-pixel 
kernel at 10-million kernels/sec Weight RAM Virtual scrolling Image memory 
wrap-around Supervisory computer 8085^ 8-bit microcomputer CP/M-80 operating 
system Compiled Basic 
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ways 



he .features of the present invention can be implemented in various 
Various configurations have been discussed, such as with reference to 
Figs 1A to IH. 34A, 35D. Another configuration will now be discussed with 
reference to Fig II. Database memory 13DA can be a digital database memory 
for storing digital image informa tion to be loaded into Puffer memory 13 0B". 
Preprocessor 13DC can be" used to perform various types of preprocessing; such 
as low pass filtering, shading, topological line generation, and pseudo-color 
generation . Preprocessing can be performed slower than real time, where real 
time operation can be "performed with geometric processor HID and where 



preprocessed information may be needed slow er than real time to load image 
memory lllC. The image in butter memory 130B pan be low pass filtered and 
Med and can have topological lin es drawn and pseudo-color applied prior to 
loading into image memory 111C. " . ^ 

Low pass filterinq^an be implemented with kernel processing, such as 
rtiscussecT tor the FTR.^A5C program seFtortn in the BAb r iC PROGRAM LISTING 
FfrR.ASC herein and as discussed tor_the spatial filter her ein. The weight 



FTR.ASC herein and as discussed tor the spatial filter herein . The weight 

kernel can be shaded, such as with cosine shading w eights, or can he 

unshaded, such as with constant weights . ~ i , ^ ' , 

ThP imagp in image memory 111C can be loaded from buffer me mory 130B ]n 
response to geometric processing; such as in response to translation. 
expansion, and compression processing . The image in image memory 111C can be 
processed under control or geometric processor HID; such as for rotation, 
translation, expansion, compression, 3D-perspective T warping , windowing, and 
overlaying . Some ot the geometric processor operations are" 

034 

relatively slow operations that can be performed with a serial processor, 
such as serial processor 130D; as discussed below. , 

In one configuration, the geometric processor can be implemented having 
parallel arithmetic operations" tor generating pixel addre sses along a line 
and tor generating line addresses . The pixel addresses along the line are 
typically generated at relatively high bandwidth, such as at 10-MHz. The row 



time share other processing; such as liD-perspective processing for chanq i 
row- related parameters^ Serial processor 130D can "be implemented with 
difference eguation processor , such as a digital differential analyzer (DDA) 
as discussed in Patent No . 3, 586, 837; wnich is incorporated "herein by 
reference. A serial DDA^ can be implemented with a computational element time 
shared between a plurality of computational operations that are stored in a 
memory for time sharing the computational element , " 

Occulting can be implement ect with occulting processor 130K and occulting 



buffers 130L and 13UM, such as for topo logical occulting . As previously 



discussed, geometric processor HID can" geometrically process the image in 
image memory 111c to scanout a geometrically processed image, which can be 
loaded into " 
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occulting buffer 130L as a geometrically processed rectilinear coordinate 
image . Occulting processor " 130K can pro'cess the rectilinear image in 
occulting buffer 1 3 PL in polar coordinate form, radially scanning the 
buffered" image to introduce occulting projections as a function of "pixel 



altitude and scanning or projecting the image into occulting buffer 130M in 
polar coordinate occulted" form . Ogculting buffer 130M can be considered to 
perform a polar coordinate to rectilinea r coordinate conversion by scanning 
but the occulted image in raster scan fornu 

venerating 




real time imagery for displaying with the database imagery . The camera 
signals can be processed with converter 130H, such as for NTSC to analog RGB 
and analog RGB to digital RGB conversion . The digital RGB information can be 
loaded into an image buffer 1301 . With image buffer 1301 implemented in a 
double buffer configuration, a new image can be loaded into an input buffer 
simultaneously with a prior image being scanned out for display . With image 
buffer 1301 implemented: in a single buffer configuration, a hew" image can be 
loaded into a single buff er simultaneously with a prior image being scanned 
out for display : THe real time .camera, im^ge in buffer . 1301 can be 
geometrically processed wi th geometric processor 130E to superimpose dynamic 
real time geometric pro cessing on dynamic real time camera images. The 
images in image memory Mile and camera buffer memory 1301 can be overlayed 
or can be windowed together, such as with multiplexer 130N under control" of 
geometric processor HID. For overlaying, geometric processor 
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HID can be implemented as a multiple geometric processor for simultaneous 
geomelfric processing of the 2 - images " for overlaying therebetween . For 
windowing, geometric processor HID can be implemented "as a single geometric 
processor time shared between ^ ~ " ~~ ~ 




controlled by a range parameter, such as generated in geometric processor 



HID. The range parameter can be generated in conjunction with , 3D- 

)erspective geometric processing or can be generated with other pro cessing . 



perspective geometric processing or can ueneidL^u wilu uuicj. vj-v^z>z>±llu . 
The range parameter generated in "digital form ca n be applied to a multiplying 
DAC to generate an "analog voltage^ that is a f unction of range. The analog 



DAC to generate an analog voltage that is a fun ction of range. Ihe analog 
voltage can be applied to the reference of th e video DACs ror modulating 
image intensity, as a function of ranged Other elements ^ can be include d in 

the arrangement, such as a spatial processor operating a£ sub-pixel 

resolution. 
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Discussion of Figs 1J And IK, 

An alternate configuration will now be discussed with reference to Fig 
1J. Supervisory processor 131F can cont rol system operation. It can provide 
interactive communication with ^ an o p e rator througft 'operator pa n el 1311 and 
with host computer 13 1H through data [ linK T lJlG. "Supervisory processor 131H 
can control a simulation scenario under control of scenario driving functions 
generated by an operator and bv a host computer. High detail information, 
iuch as terrain mtormation, can be. stored in database memory 131B. A 
hierarchial memory map arc hitecture can be used; comprising database memory 
131B, image memory' 13 ID, and refresh memory 1J1K. Database memory 131B carTBe 
implemented to contain large amounts of high detail information in memory map 
form, which can be selectively accessed for loading into image memory 131D". 
Tmage memory 131D can be impremented in memory map" form for an area of the 
environment that isTaraer than the viewport area . Refresh memory 13 IK can be 
implemented in memory map form and clipped to the viewport for display on a 
CRT monitor . ■ . 

THe Hierarchial memory map architecture extends to memory traffic. 
Database memory traffic may be lowest, being used to update image memory 131D 
as a function "of scenario "progression between mosaic frames for motion past- 
frames. Image memory traffic "may be higher, being used to r update refresh 
memory 131K" as a function scenario progression within a mosaic frame for 
motion past pixels. Refresh memory traffic can be highest, being used to 
refresh monitor 131L at about a lU-MHz pixel rate for medium resolution 
display (b!2 lines ) and at about a 40-MHz pixel 
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rate for a high resolution display (1024 lines) . 

Image processor 131E can access static area information from image 
memory 1~31D to transform this static information to real time dynamic 




membry 131D; Database memory 131B can be used in conjunction with an 
analog- to-digital converter (ADC) 131C, such as a flash" ADC, to provide 
digital frame information for storage in image memory 131D. 

A video disk can store about 50,000 mosaic frames (about 10- billion 
pixels) per side. The frames can be stored haying the highest spatial 
resolution that is required, then can be spatially " compressed with" image 
processor 131E to form an image suitable for the particular display scenario . 
For example, in a flight simulator application, frames can be stored for the 
highest zoom magnification and lowest aircraft altitude required, then can be 
spatially compressed to the lower zoom magnification and the higher aircraft 
altitude as they vary through the dynamic 
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simulation scenario . 

Image memory 131D can store multiple frames of information in mosaic 
form . A viewport window can be controlled by image processor 131D for 



memory 131D can be configured as a mosaic or video frames , as shown m fig 
IK. The viewport is implied by the crosshatched window 131M, which can be 
rotated, translated, and otherwise geometrically processed in image memory 
131D by image processor 131E. As viewport 131M translates towards ah edge of 
image memory 131D, supervisory processor 131F identifies the frames to be 
accessed from database memory " 131B for extending that edge of image memory 




near the center of image memory 131D. Wrap-around cap ability can be provided 
in all four coordinate directions, where image memo ry 1 31 D mav be considered 
to be spherical in natu re. This permits viewport 131M to continuously move in 
a particular direction preceded by new mosaic ele ments select ed tor 
progressively extending image memory 131D in the direct ion of motion . 

Image processor 131E provides real time rotation, tran slatio n, spatial 
compression, anti-aliasing," and other image processing operatio ns to achieve 
a dynamic image derived from the 
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static image in image memory 131D under control of the dr iving functions 
generated by supervisory processor 131F. Image processor 131E also provides 
the capability to warp the image; such as to warp for simulation applications 
' " Spatial _ compression can be 



or to remove warp tor displa y precision. Spatial compression can Zbj 
implemented as a function of" range to provide "a 3D distance perspective, 
Viewport 131M can be panned oyer image memory 131D as a function of tilt or 
aircraft bank angle in conjunction with range-related spatial c ompression to 
suitably compressed an image as a function o~f range . Such p anning and spatial 
compression can be along lines of constant slant range/ which necessarily 
crosses lines and columns of i mage memory 131D at angles consistent with 
aircraft roil, pitch/and heading angles . Consequently, spatial compression 
can represent the superposition" q-f various para meters; such as slant range. 



jn qr various. r 

altitude, zoom, and other related parameters T ~~ 

Image processor 131E can be implemented 1 n _ various a 



configurations . In one configuration, image processor 131 can be implemented 
in digital form . Alternately, analog and hybrid configurations thereof can be 




ternate 



provided! ^. ^. ^ • ■ a- i ■ , 

^. * 4. digital processing can be 

"forms ." Special purpose 
, can provide rotation, 

, .. L ,_ L ._ -jssina ." General purpose 

processors, such as a stored program computer and a microcomputer , can be 
used for a software implementation and a~ 
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firmware implementation respectively. For example, an AMD 2900 bit-slice 
microprocessor can be used for a firmware implementation . Alternately such 




processing . Matrix transformations can include a group _ 
rotation, translation, scaling, and compression matrices . 

In an analog configuration, analog "signals can be generated relating to 
translation, rotation, and compression "parameters and can be manipulated WiTn 
analog circuits; such as analog differential amplifiers for addition and 
subtraction, analog nonlinear processors for multiplication and division, and 
analog function generators" ! 

In a hybrid" configuration, parameters can be generated in analog and 
digital form and can be processed with hybrid processing circuits, such as 



. _ For example, initial conditions can be 

generated for in cremental elements, suqh as \he arc center parameters aria 
endpoint parameters for a PDA circle generator and slope parameters and 
endpoint parameters for a PDA vector generator . 
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The consideration of parallel accessing of multiple pixels from image 
memory 131D in the presence of rotation will now oe discussed. A 
configuration ca n be provided to simultaneously access multiple adjacent 
pixels from image memory tor spatial fil tering (w ith weighting) into a single 
output pixel . Image memory 131D can be partitioned into planes and/or blocks 
for parallel accessing of multiple pixels . Rotation heed not cut across 
boundaries of memory planes and/or blocks relative to parallel accessing of 
pixels. This is because adjacency between pixels can be fixed and need not 
vary as a function of rotation . In one configuration, the processing selects 
the" center pixel of a group of pixels in image memory I31D, accesses the 
selected pixel and adjacent pixels from image memory in parallel, weights the 
accessed pixels in parallel, sums the weighted pixels, and transfers the 
resultant spatially "filtered pixel to the appropriate rotated pixel address 
in refresh memory 131K . The relationship between the address of the center 
pixel in image memory and the address of the spatially filtered pixel in 
"refresh memory 131K changes as a function of rotation. However, the pixels 



adjacent to the selected center pixel in image memory do not change asl 
function of rotation ^ Therefore, the above described parallel accessing. 



weighting, and summing of adjacent pixels from imag e memory 131D need not 
change as a function of image" rotation . , _ ^ , . ^ , 

: The contiguration discussed with reference to Fig 1J can be implemented 
in the form of a single terminal or multiple terminal configuration : In a 
multiple terminal configuration, resources " 
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can be shared between terminals, such as to ha ndle Peak loads, — This can 
reduce costs and increase capabilities . Costs can be reduced because each 

terminal needs t he dedicated processing sources to handle the average 

processing load, but does not need the additional dedicated p rpcessing 
resources to handle the p eak processing load.. Capabilities are increased 
because a global peak load processor shared between multiple terminals can 
have significantly greater processing capability, such as based upon cost 
constraints, then "a dedicated peak load Processor at each terminal . . 

Use of a global front end can reduce costs and increase capabilities . 
Costs ~can be reduced by providing a single front end shared by multiple 
termina ls. Capabilities ~ can be increased because a global front end shared 
betweenlfulflple terminals can have significantly greater capability, such as 
based upon cost constraints, then a dedicated front end for each terminaT7 



based upon cost constraints, then a dedicated front end for each terminal _ 
Zoom capability provides a good example of advantages of a global peak-load 



processor. Zoom may be a peak load task because of the need to rapidly 
compress of decompress an image by a large factor . This can involve 
integrating and anti-aliasing of a large number of pixels m a short period . 
However, the duty cycle for zoom processing may be very low, where contention 
between two terminals generating zoom commands simultaneously may be low. 
Therefore, a single zoom processor can be shared between all terminals, 
providing significant peak load capability yet having a low cost per terminal 
i.e.; one sixteenth of the zoom processor " cost assessed against each terminal 
in a sixteen terminal system . 
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In addition to peak load considerations discussed above, other 
considerations can be optimized for a multiple terminal system. For example, 
if eacn of a group of terminals is constrained to the same general display 
scenario "tneff image memory 13 ID can be 

implemented: as a global front end and can be shared between .ail terminals in 
the group : use or a dedicated linage prpcespor 131E and dedicated refresh 
memory 131K for each tertpinal m combination with the global front .end 
permits independent operation of each terminal. Image memory 13 ID provides 
a good example of advantages of a global front end . Image mentory size is an 
important cose and performance consideration. A larger image memory reduces 
traffic between database memory 131B and image memory 131D.and reduces look 
ahead processing j_n supervisory processor 131F . Sharing pf image memory 131D 



various alternate configurations- For example , .the system. can be implement~p[ 
7g g L Wd"alone system wltftout an external host computer 131HI. qx alternately 
tn tne host coffiputeg - jtfncciogs "being jp^xnompd xnKr^n^xxyi .such ,as . in 
s u pervi sory processor 131F . Database memory 13 }B, discussed , above in the 
configuration oi>n analog video disk, can be implemented with the other 
analog memory de vices. For example . an analog videotape can be .used as an 
alternate to-" gin ^analog video fliSc . Alternately, aalaDasfe memory i5lB can, .he 
implemented withan 
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analog CCD memory : such as discussed m U.S. Patent No. 4,209,853; 4,209,852; 
No 4,205, 843) and 4,322,819 and U.S. Patent applications 3/N 6l2,285; S/ti 
844,765; and S/N 160,871; which are herein incorporated by reference.. 

Alternately, dat.ab.ase, memory 13 IB can be implemented with digital 

memories ; such as digital video disk memories, "digital magnetic 'disk 

memorie s, digital integrated circuit memories,, digital magnetic. tape r ana 
other d igitgiTmemQrie s . For exampXeT a, large, aigitaX magnetic disk memory 
having aoout ^QQTmegaoytes o£ storage .is available. firom Fujitsu and can pa 
use^ ror ^a , fligital dataoas^i^moEY-- Photographic and , optical memories can ,be 



>a rox a digital database^ memory ■ Photographic and .optical memories can^be 
> d tox database memory i3iB. For, examplerTthe environment can be recorded 
frames" Qt mm wfticn can be selected ana scanned with a video camera to 



on trames^ot film which can p<= 

generate database infcomation. ^ ... T , ^ ^ ^ . ^ ^ 

image memory 13 ID and refresh memory 13 1K have been discussed above m 
the form of IC-RAM based mempries. Alternately, image memory . 13 ID and 
refresh memory 13 ik cart be implemented witn^other memory devices. For 

example, image memory 7T3 ID >ncl fetresh memory 131K can be implemented with 
CCD memories 7 such a 5 described in the above - ret erenced patents and pa tent 
applications. The CCD memory may be an analog or a digital CCD memory. For 
example "an analog CCD mem6ry tiay be" used, in conjunction with an An alog 
database memory for storing analog information m 'an image memory t hat 
accessed from an analog database memory without an interfacing ADC". In t 
configuration, analog refresh information can tie loaded trom the analog 1m 



— 1 1 ^ 
n this 
image 



memory and stored in an analog refresh memory. 
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dynamically updated version ot tne static memory map (Fig IK) . As the dynamic 
conditions cfiange" tne aynamic from the sta tic 

memo ry map in l'mage memo ry . Tn 1 s p rbvide s tne advantages ot naymq an image 
memory tnat has not been modified for dynamic cpnditions, such as with tne 



memory . ~ . ~ - — , . -~ 

database memory information, and that nas rapid acceps (more rapid than 
database memory access) f;or restructuring the dynamic memory map as a 
function of scenario dynamics. The dynamic 
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memory can be smaller than the image memory and larger than the refresh 
memory . For example, tne dynamic memary can b"e smaller tn^n tne image memory 
because the dynamic memory has faster access to the image m the image memory 
then the image memory has to the image in the database, memory. Tfre dynamic 
memory can be larger than the refresh memory to. proyide a multiple frame 
mcpsaid. The dynamicf memory and refresh memory combination can be implemented 
with a double buttered ret resn memory, where an old image is . being , used to 
refresh the display while a new image is being transtormed trom the image 
memory . 
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Discussion of Figs IL, To 10 , . , . ^ ^ 

An arrangement vn.ll now t>e discussed yith reference to. Figs IL t<? 10 for 
image processing having rotation, translation, and compression of an image to 
further illustrate various features of the present invention. .The arrangement 
shown in Fig IL can be related jto the arrangement discussed with reference to 

Fig ij as "follows, jnput device 132A may be database memory 131B, input 

memory 132B may be image memory,, .image processor i32c" may be. , imagi 
processor 131E. output : tnemory~l32E > may be ret re sn memory 132K. and display 
monitor 132E may be "monitor 131L" , , . 

One form of this arrangement will be characterized as transferring 
memory map information from a first memory to a second memory ana 
transforming the nature of the memory map inf orpiation; such as with 

translation. rotation, and spatial compression: during the trans ter. Edge 

processing may ^ trom tne input 

memory map and selectively stroking these "pixels in, "tne out put memory map: 
where" the" selection ot the, input and Output pixels facilitates ~ image 
processing . . ... 

An input device 132A generates an input signal to an input memory 132B 
for storage m memory map form. Image processor 132C processes the input 
memory map stored m input memory 132B to generate an output memory map for 

storage in output memory 132D. Altern^^ly, iflPut,, signals 3,3 an. may be 
processed directly with ^mage, pyocessor, w^cnout uae ot .input memory 



processed directly with image^processor n jj^ w\t^out us_e ot .input memory 
13 2B. The memory Trap in output memory 13 ?D £an t>e used tp retxggft display 
monitor i,32B_ ,£or display of a processed image, input device 132A may 5ea 
data acquisition system such as a radar, sonar, video, or other 
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a database memoryj or othey.,^i?p^t device. The 




a database memory/ or other,, apput device. Ti 
{ mag fcorm, in H Aagut memory 13 tor processii . 

lput signals 132W may be scan-relatea signals^ 

<5r a video input, pfi or polar coordinate scr 



;uch as raster scan signals £0r a video input, pfi or polar coordinate scan 
signals,, tor sonar and radar,,, systems, "or other scan- related signals, 
uternately, iqput signals" \zn may" be o5£ainea trom a host computer, a 
database. Or other source of ima ge ffltor mat ion . ^ 

Two memories, input memory 132B and output -memory 13 2D, are shown for 
storing memory map information. In one; configuration, image processor 132C 
accesses memory mfcp information from" input mem ory 132B Tor processing gn3 
subsequent storage in output memory 132D in memor y map for m. Alternately" tne 
input "memory map'and tne Output memory map may fte stored "in tne s ame mem ory. 
sucn as tor" m-piace processing; may 5e stored m otner tnan memory map torm: 
or may otherwise t>e stored . 

image processor 132C may include line generators , such as discussed with 




selection fit an array or pixel word s from an fnpnt: memory map ana staring the 
IllecE^ array of jifcel wBraa; 

in this manner cfan Be u sed" >,o provide translation ■ rotation, zoominfr. 
id other sunh operations 




050 




rotation and transiation TThsy ran be usel tio S an input non- rectangular 
array ot pixels inEn an output rectangular array ot pixels, such n and 
Eradiati on. 'JHe y nan oe Tused to m ap an as tor rotation input non-rectangular 
rr _.-... tr ^ nt . {? an output npn-- rectanou I a r array_ ot JBixels . sucn as_ tor 



array ot pTxelginto an output no n-" rectangular \ rra Y Qt Pixels, such as tor 
rotation and transit map ping ot ; one . array ot Pixels into 

another array ot pi x els can be u sed to transform coordinates, sucn as polar 



inn- 



er transl 



imag<; 



generator and a row start point address generator 
arrays of pixels 132F to 13277, and 132N. A pa— 0 
at tne start — ~" n — — ^ " ~ 
$ng can incre 



.scussec 
address 
address 



Lerator) may be used to address 

— . ^ v , xel, address .generator can begin 

point of the line, such as at the" left nana pixel ot the line" 
mint 'across tfie line at tfie selected siopgT Tfie'selected slope 
is zero for array 132P and is 0.5 for arrays 132J ^nd 13 2N. The start point 
or row address generator .selects t{ie start point .of the line, it is 
incremented at the completion of a line, generated with the pixel address 
generator, to generate the 
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selected slope of the start points 132H, This selected, slope is zero for 




generator to the pixel 'address generator ot the pixels along the tine with 
the generating " tne coo rdinates row "address pixel address generator, and 
clocking the start" point generator increment /to advance TKe 



the end 
he next 



___ -wlTC -j _ - _ 

■art "point pixel "coordinate ~pf 

point. ----- 1 



start point row address generator to the next ^ ^ 

tne ne^ t ^su bs equent rosaE., . This next ^ start point, pixel — , 

transferred to tne pixel address generator as tfle initial condition for the 



cpopdinate is 



next scanline. The pixel address generator, is clopked to generate the 
coordinates of the, pixels along the next scanline. A distance -to-go (DTG) or 



re s g 



ine cgndit^gn and a last line 
132D, can have 



endpomt implem entation , the start point, row , apo 

Simultaneous generation pt a last pixel per line condition 
con d i t ion can ind ent it y tne compietigiL ot xhe frame scanouET 

Each memory, input memory 132B and output. memory 

corresponding s§ts of address generators. The input address generators 
associated with input memory 132E^ can £e used to address an array of pixels 
from input memory 13 2B for accessing. The output address generators 
associated with output memory :j.32D can be used to address an $rr$y of pixels 
m output memory 132D for storing. Therefore, separate arrays m input memory 
132B and 
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outt 



)ixe 

?ixel-by-g;i,x,ei 
lectea pixels 



lxels 



:rom input 



into 



seiecte 
can 



lxels in output memory 



an inpu 



lal compression an 



array 



memory 



-ession 



or . an 



Xgr 

ss "generators " fpF 'tHe 1 output ""array""^"!! "5e~m6ltiple 



aadress .generators tor 
rocl 

an iripuE 

:o output memory^T 



double crocked, trip le 



array 



Alternately"; tne 
clocked: alien as doui 
' LL ' 



t laT decompre s s lon when 1 oadi 



a 



o reduce 



Weighting and integration 
arrangement in patent No. 



4,209,843; which is herein incorporated by reference. Fop example, the input 
samples T therein may be a scartned pi yel array stored in input memor y 13 2B 



herein t he weighting may be performed with elements 625 and 626 therein, and 
the Qiitput memory 1A2Q Herein rgr accessing 
and integrating weighted (Fig bu therein and Fig ii^ herein) . 
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An aircraft map following navigation application will now be discussed 
to illustrate use or the arrangement discussed with reference to Fig 1L. This 

application presents a dynamic map displr" c ~ ~" " ~ 

database for aidi ng m navigation . An ' - 



image 




Is "stored" in memory map form in input memory 132B. This can be a prerecorded 
age stored m database a n d loaded into infout memory 132B. The database may 
"sell c ontaTned in the syshem or mav be transmitted from a remote source/, 
put device [ Y.V2A can be a map dat abase generating map video signals 13 m for 
firage in input memory fi2fe in mem^ 

Fn fnpvit- memory 1A2C J can tie perf ormed with address generators identifying 



YnFn fnnn> memnry rr^r" can be performed with ad dress generators identifying 
the pixels along the scan iinejtor storing or scan line information or w TFg 
various o T.her Methods " tor loading a memory map with image information. The 
mSmnfy map i n innii> memory liriB ^ may be a" conTposite ot many map images or 
mosaics over a larger area. Arrays .in tne inpdt memory map in input memory 
1 1?5 ma y ae seiechga and p rocessed 1 with image processor 132C for loading into 
mi ^.pu t 'memo ry ~1 l2p. As the aircrat t ■ translates over the terrain ■ the s tart 
poiRE pixel Jot the array" is tra n s T a ^ 

memory ±jj'2B tQ~ tra nslate /the viewing window dispiayed-on display monitor 13as 
consistent wi tjT a ir era t £ motion, ^C^^siriv. fd~the aircrat t " "rotates in 
zimufn7 the address'generators are loaded with the globes of the lines Of 
he array . therehy "et tect ively "rofcat ing the displayed window L in_the L memgry 



azmui 



t?he array 7 thereby "ef f ectiveJfe u rQtating tne Q^sgtiy^^ ] S99 w i-iOVf m 2£ v 
map stored irTj.np ut memory - IT^b. Theretore . as xne aircraft translates and 
rntar.es over the 'terrainT^the display 
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window s imilarly translates and rotates over the memory map to present an 
image depicting 'the environment below the plane . ^ . " ~ " 
3 rhP azimuth angle nt the aircraft can be u sed as a driving function for 

the address generators . The . heading angle .can" be , proce^saed >ith an afg 
---- "T-i. -Sn to obt aintFe slope ot ttie J- 1 " 1 * 5 anct the component 



tangent calculation to o btain the "slope ot the line and the component 
rectilinear vecto rs . Alt ernate address generator embodiments, such as using 
either slope or rectilinear component vectors, can be provided . Theretore; 
the i nitial" conditions f or the address generator can loe derived from the 
azimuTpTangie for rotation.. . . 777 77 7 7 . ~ ~ ~ 

(Overlays may 5e provided with the arrangement shown in Fig^ 1L. For 
example 7]overlays including ve c tors points, alphanumerics . and symbols canbe 
cene^ated in input memory 13 2£ in inemor y ma'p torm. These overlays can be 



processed with the "imag e. Theretore. overlays may be processed in similar 
manner to and in conjunction with the images discussed" above . Alternately. 
overlays can be rotated, transla ted, and otherwise processed, such as with a 
geometric processor in line endpoint torm and then generated with vector 
generato rs and character generators tor introduction inco output memory 132D. 

Various arrays ot pixels will now be discussed, with reteirence to Fig.lM. 
A rectangular array of. pixels 132F contains horizontal rows and vertical 
columns of pixels organized in a 
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rectilinear coordinate system- A non-rectangular array of pixels I32i 

contains lings of v - 1 - — * -.-^t 

has lines in tr 




rectiimear coordinate system. Array 132N has no line in the rectilinear 
coordinate system/ Each line of array 132.F can be s canned with an address 
generator having a slope of zero and each line pF arrays 1321 and 132N can be 
scanned with an address generator having a slope or l /a. subsequent lines 
progressing downward, in "each of the . arrays 132F, TT41, and 132N can be 
Scanned by decrementing (or incrementing) the start point pixel address oT 
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u pdating the pix el address generators 



of pixels % 

S patial com] 




generator using- a second address generator along ang thai 
address , generators can Joe used to load one array ot pixel 

ipression can be implemented by undersampling, such a? 
second PAxeT, .every Third pixel , .every, JQftgtn phwj, , etc 
ne and similarly selecting^ equal steps in the scraniine toi 



ma pping a smaller array into a larger array tor spatiaJT expans ion an d mapping 
a Tarter array into a small er "array Tor spat lal com p r e SsTon ." " sugn JmStial 
expansion ancT compression i can oe performed along rectilinear coordinates or 
non-rectilinear goordinates . sucn as discussed witn reterence toFiglM 



above . 



Tn alternate configurations, the input memory map in memory 132 B can be 
largertHa n "equal toT dr smairer than the ouEput J membrv map in meinorv iJ2p 
In a T contiguration where tne input memory , m^p is. larger tnan tne output 
memory map J the output i mage can ^oam through ehe input memory map; such as 
by trans f erring a ^portion of the input" memory map ; properly rotated , 
^ranslatea scaled . and otherwise p rocessed : into^ tne "butp^ut "memory map tor 
dis playing ot a rotated, translated" scaled and otherwise processed p oril 



dis playing ot a rotated, translated, scaled and otherwise processed portion 
of Fne^fmgge in tne "memory map scored in input memory 1J2.B on display monitor 
i V;fc Knr example, lnpiitrmemory 15^5 may shore a large map ot an ; environment 



iv;k. Knr example, input memory 132B may store a large map ot an environment 
(either sonar, radar, video, or (O therwise) and output memory 132D may store 
4 portion ot the T environment pert inent to the operation m progress , , ,, such as 



a poraon of tne the operation m progress , such as 

Fh| portion ortfte environm&t around a vehicle Deing navigated? The array 
selected trom the large memory map 
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stored in input memory 132B 
position and~orientation ~" 




portion ojE the image in output memory l52D A translation example will now Pe 
Si scussea with reterence to Fig IN as illustrative of. rotation and other 
processing. A larger memory map is illustrated as stored. in input memory 132B 
with pixel array i32P having a visual event 132Q contained therein. A first 
array of pixels 132R *s selected and transferred to output memory 132D in 
memory map form having event. 132Q contained therein. For subsequent 
processin g, the selected^ array is translated in X and Y to array position 

having event TSYo lnTlilig' upper left hand corner. This is an apparr-" 

at ion ot trie "image "to T the Yower right, trom array 13 2 R to array \\ 
^nput array l J, 2 P and an apparent translat ion ot eVent li 2U towards ^ t 



translation ot the image to tne rower right, trom array ij^k to array xjza 
within "input array l J, 2 P and an apparent translat ion ot evbnt li^y towards trie 
upper left ot the output arrays' ~132R and 132S. Output arrays 132R and 132S 
are shown superimposed on input array 132P and are also shown separately to 
illustrate the translation of output arrays 132R and 132S relative to input 
array 132P and to illustrate the apparent motion of event 1320 .from, the near 
center position in output array 132R to the upper left position in output 
array 132S. Similarly, image rotation compression, decompression, and other 
image p rocessing can Pe performed by manipulating memory maps. An image 
processing arrangement m accordance .with Figs il< to in will now be discussed 
relative to the flow and state diagram of Fig 10. Two sets of address 
generators will be used. 
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addre.s 



address for the array. the 

---in line or pixels tor each 



arameters lor each address genera t 



the del ta-T and delta -ff parameters iof tFe slope of the start points of 
scanlines ot pixels tor each start point row address generator, and the X 
and Y-pTG parameters tor each start point row address generator . ~ ~ 
The X-DTG and Y-DTG parameters tor the address generator are loade 



r£pTG parameters tor each start „ _ _, 

The X-DTG and Y-DTG parameters tor the address generator are loaded in 
operation 133B. For an array having equal length lines, such as. shown in Fig 
lm, the X-DTG and Y-DTG parameters are the same for each line. In other 
configurations, these par ameters may be varied to provide different types ot 
arrays . The pixel address generators are clocked Hi operation 133 C to 
generate the new output conditions. . 

The pixel address generator? for both, input memory 13 2B a n d output 
memory 132D, are clocked in operation 133C. to advance to the next Pixel along 

the input line and output line of pixels. The output conditions are 

generated, such as with a table lookup, and the X-DTG and Y- DTG parameters 
are decremented m operation li.iD. in" operation 
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3-33E, a. pixel word is accessed from input memory 132B, as addressed by the 
input pixel address generator, and stored in ou.tput memory 132D, as addressed 
by the output, pixel address generator. A test iS then made in operation 
to detect the last pixel in the line it it is not the last "pixel in the 
line, the logic loops" back along the no path to agaq.n clock the pixel address 
generators, in operation 133C to process the next pixel in the line. When the 



last pixel in the line is detected in operation 133F by detection of the DTG 
parameters being at zero, the logic branches along .the YES path to operation 
133G to detect the last line, .th.e last line is not pfesent, the. logic 
branches along the NO path to initialize processing .of the next line pf 
pixels with operations 133H and 1331 . If the last; line is present, the logic 
branches aloifg the YES path to exit t.he iterative lQops .as pompiLetp-ng the 
transfer of the selected array of pixels. A new line is initialized by 
clocking the start point row address cfenera to r in . o peration ^JH and j,QftQin§ 
the new sTart p oirft initial conditions generated with the start point row 
art flrfss generator into the pixel adctres s ; generator t or each „m e morj "fo 
Initiate t# ,si gr gt He next r iTne oj pi xeJ.s . The^ logic then loops ftaCK to 
operation 13 iB to loacf the ! X-DTG and y-dtg parameters^, for the next line of 

§ixels and then generates the next line with operations 133C to 133F as 
iscussed above. Address generator operations discussed with reference to Fig 
10 provides for iteratively scanning an input array in input memory 132B ana 
an output array in output memory 13 2D for 
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the 




scaling and other differences tnl 
image displayed with monitor 132 
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Other Configurations . ^ _ ^ ^ , . 

Various configurations of the system of the present invention have been 
discussed with reference to Fig 1 above to illustrate how the various 
features and devices of the system of the present invention can be used 
together to implement a system. These cpnf igurations ,are. illustrative of the 




er contiguralions that can be implemented with the teachings herein can i5e 
• .ferent applications.- exemplary applications being g - -- 




operation in conjunction with a raster scan RGB. color CRT display monitor. 

Alternately, the system of the present invention can be used with scan 

arrangements other than raster scan arrangements, monitors other than CRT 
display monitors. colpr a rrangements other "than RGB coigr arrangements, and 
non- color monocflromatic dis" 1 ' 1 — - 



npn-color monochr omatic display monitors and can pe usea in systems witnout 
displayin g ThV procesW beam control 

arrangements: sucn as Wf scan- A- scan, calligraphic. Palmer scan, and other 
arrangeme nts can be used. For example, the geometric processor can scan the 



arrangeme nts can be used. For example, the geometric processor canscan, the 
image out of image memory along the scaniines" other than raster scaniines ; or 
the geometric processor" can scan the image out ot image memory and into a 
refresh memory. where the desir ed scan is "used to scan Tine image out ot tne 




calligraphic CRT display monitor, a" 
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liquid c rystal display monitor, a plasma display monitor, and other display 
monitors . 

The different featur.es disclosed herein pan be. used in different 
combinations , .and . with different interconnections illustrated by the 
exemplary combinations and interconnections discussed herein cut not limited 
to the exemplary, combinations and interconnections discussed herein . 

The block diagrams shown herein represent various configurations in 
accordance with the teachings of the present invent ion.. However, many other 

conf igurations can be impleme nted with the teachings o_f tlie present 

inventio n. For example, various elements have been shown separately tor 
convenience ot discussip n. wnere such elements can be integrated together. 
For example, the geometric processor and spatial processor, the preprocessor 
and the 'geometric processor, and other elements "can be integrated together 
into combined el ements Aiso L various elements have been shown integrated 

~""~:h eir- 



together" tor convenien ce ot discussion. wnere such elements can ^e 
implemented separate trom each other For example, the geometric processor 
has been discussed tor implement ing*thecombineci capabilities of rotation? 



anslation. expansion, compression. 3D-perspective. warping, pverlaying. and 
other Function^ where suffn capabilities can be implemented separate from 
each other or in vario us combinations of being implemented together and 
separate 




output deStinat _ T __ 

specific examples of input sources and output destinations 
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have been discussed. Many different input sources and output destinations can 

be provided, input sources can.be image sensors , image generators. memories,, 

other image processing systems. digitizers communication linns. and 

multitud es' ot' other input" sources, uutput . destinations oas\ be .display 

monitors, pattern recogn ition devices. artificial intelligence devices. 

memories, other image processing systems, communication links, "and multitudes 



° f 0t i)g^gys PU Sagl St ^Ml Qn a S r e discussed . herein to illustrate exemplary 
configurati.ons. Many^ other data path configurations can be implemented. For 
example, pixel data sTreap "aft be red- forward ^ 

etemenls . *Eea-bacTc fcn upstream proces^ng elemenHs . EuHereQ, SrocesseoT 
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generall y applicable such as for pipelining of processors and memories; 
Buttering of 'intormation: and parairer processing or intgrmap^Qa . 

Various forms or buttering or intprmation is disclosed herein ; such as 
buffering in intermediate buffer memories and buffering in ^ registers , . j, , e. , 
kernel Registers 7 The system arrangement discussed^ herein. BroyAdes tor 
multiple processors operating in parallel form and pipe 
pararfgr processi n g rorft is exempliried witn tne multiple geometric processor 
cKannels . The pipeline processing rorm is "exemplified; with the preprocessor^. 
geometric processor: an&sp aHial- processor pipeline, various but rer memories 
can be "inserted b'etween processors and m "coniunction with processors 



U_so , 



mempr 



with the teachings of the present invention. For example, a refresh memory 
can be inserted o r deleted*: as disclosed in various conticrurat ions ■• image 



nd variou s 
111 
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GEOMETRIC PROCESSOR 

066 

General pescription . . . 

Various geometric processor configurations will, be described .to 
illustrate improved geometric proc.essor capability. This improv.ed capability 
includes hardware efficiency, high speed, and many geometric processing 
features . Advantages are derived from conceptual features, su ch as a window 
having multiple geometric processing operatidns ■• from hardware features, such 
as an lmprovetl arrangemsiit-. of devicfes : and logical features, such as an 
improved logical design: 
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Coordinate Systems , . , , 

.Image processing will generally be diSCUSSefl in the form Of a 

:tilinear coordi nate system tor "geometric processing and spatial processing 



rectilinear coordi nate system tor geometric processing and spatial processing 
and in T the form or a p o J iar coordinate system tor topological shadowing ana 
occult; ing . utTier coordinate conliguratiohs can be used; such as rectilinear 



coordinates tor ail proc essing: or polar coordinates tor aff processing" 
different : combinations of rectilinear and polar coordinates tor different 
types of processing, and other alternates thereot . 
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Geometric Preprocessing And Postprocessing . , . , . 

Various configurations of j.mage processing are discussed m the form. of 
particular implementations herein. Howeyer, the arrangement of the processing 
elements can be varied to meet the requirements ot a 'particular application: 



implemented as filter preprocessing for reducing Spatial frequencies and as 
tiIter7postproces sing J t o? ~smo iofchi jitr ^agey^."ipkge ^memories dan he orovidec 
tor buffering images: such as a rrbnt e'nd putter memory, a shading,, but tea 



post t il ter ing arrangement s 
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Geometric processing is described herein in the cpnf iguration of a 
scanout arrangement, where an image stored in image memory is scanned, out and 
geometrically processed, during scanout -For example . the — image — in. image 
lemorv mav Be r a normal lzed liffege that has not afl vet peen .geometrical j 



brother source of pixels . Tne geometric pre-processor C an generate memory 
addresses for loading pixels mr .o image memory in a manner similar to the 
prfiviously discussed feo^t rii; processor thafc"generates memory aggresses tor 
scanning pixels out of image memory. This geometric pre-processor 
implement a tion Has many uses: sucn as tor providing a-geometrically proce ssed, 
image/ in a memory or £e£ reining i displ ay, "For'exampieV an. inpuj; gata stream 

can 3 De generated from a digitized \np\it : SUCh .as — from, a camera, — SOnar 



d from a digitiz ed input : such .as, from a camera, — sonar 

receiver', or radar rece iver: and can 'pe scanned into image memory with 
geometric p re proceg^ preprocessed image in image memory 

can fee * useti to re t resn a display, "can Be useii tor pattern recognition, ana 
?an fee u sed tor otner purpose^ ' iF provides a qeometrical ly ^ breprocessec 



£fn fie u sed tor other purposes, it provides a geometrically preprocessea 
image tnat can d p: processgd with other devices without further geometric 
processing. 
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The geometric . preprocessor may not have to be a real time geometric 
icessor: where it may be implemented to accept rgiatiyely low Oata rat:e 



ow ^ ate 



or storage in image memory . This can provide various advantages ; such as 

Here nicfher speed processing operations pan be used tD process. tM 

eometrically prep rocessed ima-ge "stored in image memory. For example, a 
^omeErically R e p rocessed image in image memory can fie used to refresh a 
isplav wiTrnout r turtner geometric processing. Also, a digitized image from a 



so, a digit lze.d image from. a 
_ .d pixel Stream is 

ility ,- sucn 



sucn as m 



Ing nas previously been discussed in. the form. of an 

address generator that generates the addresses of pixels having a 
7eometrically processed} relationship therebetween, such as having a rotated 
Ind expanded relationship therebetween. Such address generation is discussed 
■ '"- " ' itions ot ^ — — " 




5cessing to scan a geometrically "preprocessed image into image memory Ty 
generating Che geometric proceVsing r elated" addresses accompanied by wfite 
operations (in place o t tne above -mentioned read operations) tor writing 
pixels into image memory in geometrically processed torm . Therefore: 
geometric p re p rogessing can Pe implemented with an arrangement similar to 
cnat Tdiscugsed to r geometric postprocessing. : 
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Alsc 
memory can 



previous image me mory Tor scanout and to address tne subsequent image memo; 
Jor" scan -in", Tne im pleme ntations can Pe similar Put tne capapiiities cariL- 
ditferent TFor examp"ie, scan-put, from an image memory proviges the capability 
of generating dynamic ge ometrically processe'd output images in response to a 
static image "stor ed in' image memory .' Scan- in to an image-memory provides tne 
ca pability or gen erating a 'static. Geometrically processed image." sucn as for 
rerresniri'g a display ' Many other capatiilifiej ot scan-in and scan-out 
geometric processors will become readily apparent from tne teachings herein. 
For simplicity ot discussion, geometric processing disqussed herein will be 
discussed in the context or geometric postprocessing. However, thege 
discussions of g eometric postprocessing are alsfo illustrative of geometric 

preprocessing- 
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Window Geometry . ... 

One. configuration of . geometric processing is implemented by 
computationally flefimng certain parameters of a windSw and then scanning out 



ntationally flefimng certain parameters of a window and then scanning out 
tne" portions J of image' memory seen r.nrnugn tne window in a raster scan 
referenced to the window . Tne window can Be transiationaii y positioned oyer 
e memory to implement image translation, can he rotationally oriented 



image memory to implement image trans lation. can he rotationally oriented 

over image memory td implement image rotation, can Pe expanded or 'compressed 
to implement image compression or expansion respective ry r can Pe warped to 



implement ima g e warpin g , a nd can be Otherwise co ntroAled 'to provide Qtfipr 
forms ot image processing - Generating a rast er scan that is referenced to th< 
window geometry ancfflial: acc esses th§ pixels in image memory~whicn 
ho the Vincfow J geomeE r y gene rales a >gomet r i cailv' fr ro cesseq Tmage , in~ ra lEg 



ldpw geome! 
the vindo 
m form the 



ow J geome t "ry^ ||ft^ ra^es_a, . ^fe^g *g a ^ x X*# x SSJ?Jj s JJ* «- *B 



mage 



lage, inraster 

:hout the need 



o directly refresh a rwr monitor wi 



scan Form that can be usee 

tor a_ refresh memory . , , . . 

I}erining qf the window can be performed with a supervisory processor 
deriving certain window paramete rs gp_ a .once pgr tra;ne; u or .onc^e J)er , tieid 



.— ^ , . _ — -.->£ a " nre P^ r £rame ° r on SP Per tieid 

fae rajjfloa. P^rainete'fr is trans,^ 

' - tKicK car fBe aetin^'wilp.hrf imaae ngmorv goordinatg og fche 



£a£i£ 



to image memory, wmcn canDe defined wit 
corner" of thg window, tng _uqper left nan' 
raster scan 



e window, tne upper left hand corner Ot 
begins . A.nohne'r" window parameter 1 



e window, at which ti 
■ tionai position 01 



parameter is tne rotationaiPj 
r which can be aetined witntn 



tHe windo w" re fat ive to image memory r whic 
slopes ot _the^x-axis_ and Y-axi~ — 



xis addr 
window relative to ima< 



can be 
ess generators 



tne ratiool 



onflow parameter 
which can be defined with 
fpr i s the change 



is the size of t 
the magnitude of 



-.he slope parameters. 



memo 



her wiXqow parameter is 
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in the slope parameters, which can be defined with i delta slope Payamgteyg 
that wdat^ the sJ^pe pa the, raster scan ^operation.: The slope 

paraiBfitera" ran T ig jmplemenfeefl bo ujcQte Jtne address^ generators ang 



y YolproVigg ?-ne It ep sizes as the address generators scan throug 
and through image mefeory . In" one implementation , tne ratio Of th 
eters defines The rotation of the window and the vector length, o 



dS 



le slope 

genera t Qrjs ang 



onsequentT 



the window and through image me 



slope parameters 



r he window an — — . ^ „ n>J „„ 

e size of the window . For example, the square 
of the component step sizes or slopes defines 
ouently^ the window dimensions. 



the^slgpe~paramet ers~de£ lhes the~s 



root of the sum of "the squares 

the vector step size ana consequently .the window dimens: 
VECTOR STEP = SQR ((X STEP 2) .+ (Y STEP A 2J) 

in the component step sizes and ratio of the slopes cau s e s 
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Image Hier.archy . , 

The image, processing system can be configured with a hierarchy o 
images . a p i peline of images . or other combination- or images implemented wit 
a mer'are ffy of memnries 3 a pipeline qFliifries . or "other r "doi^ination g 



a rfier'arcffy or %mories. a pipeline of membries ■ or jst&ex . QQX^xn^xon dJ 
memories : one configuration or which will now be described with reference to 
Fief 2A7 Database memory. 204A can be implemented to store a very large image: 
such as a 1 -mill ion p^xel image. a_50-miiiion pixel image . a l/Z-biliion 

such 



p^xei^image 2 _ qr_ I 




ion pixel image 



arious 



memory contigu — — , .. „ . . . ^ 

A portion of the image stored in database memory 204A can be. loaded into 



buffer .memory 204B.. Buffer memory 204B can be used for more rapid access t 
- - if the image: _fgr ..preiprocess^g. ^such as, t_qr pre-Ei^ter i ir i c^an 



a portion oi 



pre -"compress i on : and tor o ttier " pu 
Putter "memory 2U4B can be s 



Se^ portion ~ot the image loaplecl - into 
d ilpoji the translated position of 



window 204D. suc h as m accon 



e vir 



n the translated position of 
tual scr olling imp~lementation 



d i s cu s sed he ire in . 

A portion of; the image stored in the. buffer memory 2 04B in a buffered 
system or a portion of the image stored m the database memory 204A m an 



tion. expansion "." compression. 3D-perspect: 
The portion ot the image loaded info image 



ige memory can l)e P selected: 



image 



075 



ft 



-j^^ 3triC — ~ r " XI -t,— -T^J— _f TC 

expahdedT compressed:' 3b~- perspective . "and w^rpecT'itnage 7 "such "as f or 'display 
on" a monitor." ; ; , , 

In one configuration, d at a base memory 204A may have the largest 

capacity, such as ybillion pixels, and/ t^e longest latency t?-™e ■ sucn as 



Y ■ sue 
d. of 



atabase memory 2Q4A may have the 
lion ^ixel^ 4 |n d a smaller 'latenpyT 



secon 



smaller capacit 



any o 



04 B may have 



^y, .sue, 
;onq, t 



_as_ 



se memory 2 04A: image memory fi?^ may have a 
Lion pixe ls, and a sjnaiier 1'atenc y time such 
er memory 2U4B: and window 2U4U" may have a 



lme. sue 



as 

small e 
a_§_ 



,- microsecon 
ier capacity, 
,u. . l-m i cro s.ecQ nd 



such as 
hen 



sm 



such as L 



miTTion "pixels, an 



s ah ^ instantaneous T scanqut. then image memory 
t oiT fiimpTicity ot discussion: the memory hierarchy has been shown in Fig 
2A t having size s, orientations , shapes . "positions: speeds, capacities: 
relative characteristic s, and other" characteristics . However: different 
sizes" i QriehYaYion^ shapes. positions. speeds. capacities, relative 



ay 

er "later rcy" time? 



smaller capacity: 
h as an" install 



i 



sizes orientations s hapes positions. speeds capacities^ relative 
characteristics, and ot her characteristics can also tte provided as an 



alternate to those described above. 
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Description of pig 2B, 
A tranplat^^ ™ r 
discussed wi 11 



or Fig . . . _ n 

ilation and rotatipn geometric processing arrangement will now be 
t;h reference .to Fig ZB. Other geometric processing features; such 
as . compression, . . expansion, and jP : Pjrs^ 
conjunction witn J£n^ rotation " and . translation S P^^ E ^^;^JF^ is 
configuration will be discussed relative to transtormmg an image stored m 
an image memory. 



in one configuration, the geometric processor discussed herein may be 
:haracteri?ed as an address . generator that transforms , agdresses g£ Pixels 
f rom"a source mem o ry i n to a d d r ess es ae ^ W atiOJl memo^ to 

facilitated tfef Qest 

memory ffH^ cnaract ex^i^. 

ThP destination memory ma y he implicit ot . a display m onitor 

and need not be expressly implemented.. Address transformation c aEL_^g 



and need not be expressly implemented. Address transformation c an be 
implemented in various waygr " In one configuration discussed .herein, a row 
a dfi^ss yenRr^Qr ana a^umn address generator generate^ Pixel addresses 
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column or pixel step s and by driving .the dependent variable — in 

syb - incremental colu^ y or pixel steps, wnege tne sub-^ncrgment 

pixel steps are determined Jpy the slope ot~ the line to be genera ted. Tne 

^r-^nmng rfr a ninra i i ty nf TiriPfl nft'RpV. T-.heretietween 205C can be used to f Qrm 

a multiple scanline image 2Q5D at selectable slope , such ,as for .Storing 

address^i pixels in anotne r memory map or tor direcfblv putbutTincr aggressed 
pixels to a Vaster scan mQni^ ot lines 255C"can be ottsetsy 

starting each line at a ditterent start pixel position at the left hand . side 
of the window. This can be achieved witn a row address generator by .driving 
the independent variable in incremental row steps and by, driving the 
dependent variable in sub- incremental row steps, .where the sub- incremental 
row steps are determined by the slope of the row line tp be generated. A row 
line 205E can be used to address the start point pixels for the column 
scanlines. 

For simplicity of discussion, the arrangements discussed with reference 
to Fig 2A establish the independent variaole .as the X- variable, and the 




X-vana m>: or the Y- variable " to, t?e de fined as "the independent 
the column address generator and tor the row address generator , , . . 

In the configurations discussed, with reference to Tig. 2p, . tor simplicity 
of illustration, translation is provided by selecting t the. initial point 205H, 
which is the pixel position that is used to initialize the row address 
generator, and 
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rotation is provided by selecting the slope of the column address generator. 
For a rectangular viewport, the slope or the row address generator can be 



?or a rectangular viewport, the slope or the row address generator ca n be 
selec te d so , tfiat . r ow, line 2Q5E is g^nfexflted to be orthogonal to cplujnm lines 
lfl5£.Tne length of qolumn lines 205C may be used ,to define width ot the 
viewport; i.e., 512-pi?cels, and the length, of row line 205E may be used to 
define height of the viewport; i.e., 51Z-lines. 
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Description Of Pigs 2C to 2F 



Description ot P,igs 2C to 2F , ... . . ^ ^ ^ . 

The geometric processor can be considered to implement a window that 1 
su perimpo sed on image memory, where the window can represent the viewport an 
t fte poft iops of jThe image seen, through the window can be displayed on the 
viewport . A configuration hayina such a window arrangement will now b 



yiewporc ^ a cont iguration haying^ such a window arrangement will now be 
discussed with reference to Figs ~2C to.2F. . . ^ . 

a window arrangement may Tbe coflsiflered as mapping a-PQrtlPh of, image 
memory seen through a window" into the display viewport:. This is different 

trom Win dowing "oA tne. viewport t where tne^ viewport is .divided into a 
plurality ot^ dit t erent ardas . called windows. ^ tor ditterent images" 

Transla ti on ot tne window relative to image memory translates, tne image seen 
in the viewport^ . Expansion or compression ot the window relative to image 



m tne viewport . Expansion or compression or the window relative to image 
memory expands or, compresses, respectively, the image seen.m the viewport. 
RQtatlon of the window^ relative to image mempry rotates the image seen in the 
viewport, Warping of the window. relative to image memory warps the image seen 
in the viewport. One qonf iguration of a window is a geometric representation 
of the pqrtion of . image memory encompassed by the scanlines. In .this 
configuration,, scanlines commence at the Gpper left hand corner of the window 
and progress m raster scan form towards tTie lower right hand corner of the 



window. Translation of the window can be. defined by , the start point of the 
scanlines relative to image memory. Rotation of the window can be defined by 
the angle of the scanlines . relative to image .memory. Size of the. window can 
be defined by the step size along a scanline. and the step size between 
scanlines relative to the pixel coordinates in image 
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memory. Warping of the windqw can be defined by the .charges in step . size, 
anal e of the scanlines, and with other parameters associate^ with the window. 
Otngr parameters can also be used to define the geometric features of the 

One configuration of window geometry, will now be. discussed .with 
reference to Figs 2C to 2F. A window ABCD is shown superimposed on image 
memory The image in ima^ge^ memory, .is representee} by the^ jpage of the figure 
extending beyond the window, outline.. The portion of the image contained 
within the window ABCD is .displayed i]i the viewport. The scanlines can be 
generated relative to the window . Jhe first pcanline begins at the upper lert 
nand corner of the window : : . point - A ; coordinate XIpl, YIpl : and progresses 
parallel to the top of the window tpward poi$t-D. The last scanline begins at 
the lower left hand cprner of the window, point-B, an£ progresses parallel to 
the bottoip of the window and ends at the lower right hand corner of the 
windgw^ point-^C_.^ Consequently, ^i}e _nqn ^r o t;a t ed^ y 1 n£o w_ s c an s - ou t a non-rotated 

center of the 



portion of image memofy to be displayed in the viewport . 

Window ABCD can be r otated abhut any point ? such as at the 

window: at the upper let t nand "corner or tHe window XIP1, YIPL; at an QttseZ 
from the center pt tne window tna£ ig within tne windQW; or , at an, of tset troiri 
the center or "tri e windc 
rotation can Jpe contr- - 

abput the center ot t,.„ ... . „ _ 

orientation ABCD to window orientation EFGH is shown 
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in Pigs 2C and 2E. Rotation about a point that is .offset from the center of 
the window: poipt-P; coordinate XC2, . YC2 : from window onentatiqn ABCD to 
window orientfation EFGH will now be discussed with reference to Figs 2D and 
2F. . 

The portion of the image contained within the rotated windQw EFGH is 
displayed. in the viewport. The n scanlines can be generated . relative to the 
rotates window . The first scanline" begins at the upper lert nana corner or 
the window: point- E; rotated coordinate XIP1, YIPL: and pr;ogresse;3 parallel 
to the top of the window toward point-H. The last scanline begins at the 
lower left hand .corner of the window, point-F,. and progresses parallel to the 
bottom of the window and ends at the T,ower right nand. corner of the window, 
pomt-G. Consequently, the rptated window scans-out a rotated portion of 
image memory to be displayed in the viewport. , . „ 

The geometry associated with rotation .about the ceyiter of the window 
will now oe discussed with reference to. Fig 2C. The window has a center 
point- 0; coordinate XCI, YC1; and. an initial ppmt for image scanout; 
coordinate XIP1, YIPl. The dimensions of ttje viewport are XbV for the 
X-dimension and YSV for the Y- dimension. , The .distance frojn the scanout start 
point XIP1, YIPI to the center of rotation, is Rl . In this case, Rl is. also 
the diagonal of the window. Hence, thq distance from the scanout initial 

§pmt XIPI, YIPI to the center of the window is Rl/2. The angle between the 
lagonal of the window and the horizontal through the center of tfte . window is 
API. The angle AR is the angle of rotation f^om the angular position of the 
non- rotated window ABCD to the angular position of the rotated window EFGH. 
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The distance between tl\e center of the viewpprt : point-0;. coordinate XCI, 
YC1 : and the initial point of the scanout: point,- E"; .coordinate Xipi, YIPL: 
is delta-X DX and deJ.ta-Y DY. The geometric relationships shown m Fig 2C are 
summarized in equation form below. 

[Equations from specification herein omitted] 
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Implementation of thip configuration is shown in the BASIC PROGRAM LISTING 
DIS . ASC_provided^h$rein a$^the_old J window geomety^s^ifctfd with^PR32$=gNf i 

cent 



the center ot the window. Tjie wrnaow n^s a center point- 0; coordinate xgi, 
YCI; a center or rotation point -P; coordinate XQ2, Y£2; and an initial point 
for image scanout; coordinate XIPl, YIPI. The dimensions of the viewport are 
X5V for the X-dimension and YSV for the Y- dimension. The distance from the 
scanout start point XIPl. YIPI to the center of rotation is Rl . The, angle 
between the vector Rl and the horizontal through the center of .rotation is 
API. The angle AR is the angle of rotation ffom the angular position of the 
non-rptated window ABCD to the angular ppsition of the rotated window EFGH. 
The distance between the center or rotation: point-P; . coordinates XC2, YC? : 
and the start point of the scanout: point-E; coordinates XIPI, YIPI: is 
delta-X DX and 
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delta-Y DY. The offset of the center of ^rotation; . coordinates XC2. YC2; from 
the center of the window; coordinates XC1, YCl; is the distance TX,,TY The 

geometric relationships shown in Fig 2D are summarized in equation form 
elow. 

[Equations from specification herein omitted] 

Implementation of thip configuration, is shown in the BASIC PROGRAM LISTING 
DIS.ASC provided herein as the old window geometry selected with PR32$="N" . 

Ariranqements for rotating about the center Qf the window and about an 
offset from the center of the window have been discussed w^th reference. to 
Figs 2C and 2D respectively , above . An alternate configuration for rotating 
abSut the center df the wlndqw and about an offset from, the center of the 
window will now be discussed v/ith reference tp Figs 2E *md 2F, respectively, 
below. Implementation of this arrangement is snown yi the Basic listing 
DISM922A. ASM transmitted herewith. Particular note should be, made of lines 50 
to 68 of this listing identifying the changes frpm the previously referenced 
listing that implemented the arrangement, shown in Figs 2C and 2D. . ^ 

The geometry associated with rotation .about the center of the window 
will now Tbe discussed with reference to. F.ig 2E. i;he window has a center 
point- 0; coordinate XCI, YCl;. and. an initial ppint for image scanout; 
Coordinate XIP1, YIP1. The dimensions of the viewport are X5V for the 
X-dimension and Y5V for the Y- 
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dimension. The angle AR is the angle of rotation frcpm the. angular position of 
the non- rotated window ABCD to the angular pos.it ion of tlje* rotated window 
EFGH. The distance fre.tw.een th.e center of the viewport: point- 0; . coordinate 
XCI, YCl: and the initial point of the scanou.t: point; -E; coordinate . XIPJ , 
YIPL: is delta i -X DX and delta-Y DY. The geometric relationships shown m Fig 
2E are summarized in equation form below. 

[Equations from specification herein omitted] 
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Implementation of thip configuration, is shown in the BASIC PROGRAM LI STING 
DIS.ASC provided herein as tn$ new wmcjow geometry selected wq.th PR32$="Y" . 

The geometry associated with rotation about, a point that is pf f set frpm 
the center of the window will now be discuss.ed with reference to Fig 2F.,This 
configuration iq similar to the geometry discussed with reference to Fig 2E 
above for rotation about the cerTter of the winqow. Tl^e window hag a center 
pomt-0; coordinate XCI, YCl; a center of rotation point-P; coordinate XC2, 
YC2 ; and an initial point tor image scanout; cqordir\ate XI PI, YIP1. The 
dimensions of the viewport are X5v for the X-dimension and Y5V for. the 
Y-dimension. The angle AR is the angle of rotation from the angular position 
of the non-rotated window ABCD to tne angular positiori of the rotated window 
EFGH. The distance between the center of rotation: point -P; coordinates XC?r 
YC2: and the start point of the scanout: point-E; coordinate? XIPI, Yipi: is 
delta-X DX and delta-Y DY. The offset of the center, of rotation; coordinates 
XQ2. YC2; from the center of the window; coordinates XCI, YCl; is the 
distance TX, TY. 
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The geometric relationships shown in Fig 2F are summarized in equation 
form below. 

[Equations from specification herein omitted] 
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Implementatipn of thip configuration is shown in the BASIC PROGRAM LISTING 
DIS.ASC provided herein .as the new window geoipetry selected with PR32$ = "Y". 

Translation can be implemented by redefining the window center boint-p; 
coordinate XCI, YCl. For example, the BASIC PROGRAM . DIS . ASC provided herein 
updates XCI, YCl as a function of joystick translational cojnmands . 

Expansion and .compression can be implemented by defining the slope or 
step size for the window. If tfie slope parameters are set at .unity, the. image 
will be pampled pixel-by-pixel without pixel replication and without 
undersamplmg to display a unity size image. If the slope parameters are set 
tp legs than unity, tne image will be sampled in J.ess. than pixel steps; 
yielding replicated pixels to display an expanded .size image. If the slope 



parameters are set to more than unity, the image will be sampled $t greater 
k1 — ------ j -■ — ^ --aage. 

)e or 



than pixel steps,* yielding undersamplmg to display a compressed size image. 
3D-] — " 1 " n 



^D-perspect ive and warping can be implemented by varying the slope 
step size 5crosg tne window . " S e t "t Ting ^ the gtep size; vary pn 

gcanline-By-scanline Basis trorn the top of the image to the bottom of 
image provides 3D-perspective caused By rotation ot tne image about the 
X-axis to tilt tne top of the window Backward into tne third dime nsionT 
setting tne step size T to Vary along a^scanline and varying tne slope ot the 
scanline s on a "scanline-py-gcanlln~e Basis from tne top of tne image to tne 
5ottom"o f tne image provides 3D-perspective caused By "rotation ot the image 
tne Y-axis to t ilt tne side ot tne window Backward into the thifc " 
fori, otner variations ot step size. 



about 
dimension 



slo pe, and other parameter s yiel d other forms of warping. Warping can resul t 

W1 in view o? e t^i e aSove ,* one method for implementing geometric processing 
is to define the scanline start point XIPl, .YtPl and the slopes, Thfe ratio of 
the X-slope and Y-slope, both for row and pixel processing, .defines the angle 
of the scanlines and consequently the rotation of the window. The vector 
magnitude of the X-slope and Y-Slope, both for. row and pixel processing, 
defines the sampling step size, or the scanlines and consequently r ,tne 
expansion and compression or the window. The magnitude of , XIPl, YTP1 Refines 
the position of the window and consequently the translation of the window. 
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Description Of Fig .2G, ^ . nn ^ ^ . . . _. 

An alternate window geometry wiljL now be.discuqsed with reference to Fig 
2G. This window geometry is an earlier configuration .that has been updated 
with the configurations discussed with reference to Figs 2C to 2F. 

9t:fterwise modified; such as to correct image distortions and to introduce 

image das tgrt ions" , posit i on can T ae implement E>y qeranxng ftflf upggr 4,eEtnana 

corner of Ene window 7 Xlg and Yip, tor a particular trame. Translation can 



UCG 




angie^Aki is not equal angle-AR2, a ngn- rectangular is provided ? ° vlcle ^ 

Tne following equations define the window" characteristics . 
DXC=LI*C0S (AR) , DYC a LI*SIN(AR) DXR=-NI*SIN (AR) DYR=NI*C0S (AR) 
DX0=-R1*C0S (A5) 12 DY0=-R1*SIN (AS) /2 
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Al = ATN(NI/LI) A5 = AR+AI^ . 

These geometric relationships can be readily understood by one skilled m.the 
art. For example, the equations for DXC, IJYC, DXR, and DYR are conversions 
from polar coordinates to rectangular coordinates for the window boundaries . 
The equations fop DXO and DYQ are conversions from pplar coordinates to 
rectangular coordinates to derive. the start point coordinates, £IP and YIP, 
relative to the center point coordinates, XIC and YIC. The equation? for .the 
angle-Al and the angle-A5 represent an arctangent of the wiijdow dimensions 
ana an angle summation respectively for deriving the start point coordinates 
from the ce^iterpomt coordinates. . , , ^ . . 

Expansion Snd compression can be implemented by defining the values of 
the slope parameters f or and compression 

can also be uped to scale the values of DXO and DYQ to derive the start point 
coordinates from the centerpomt coord inates. 
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Description of Figs , 2H and 21 . 

One configuration of translational ancj rotational geometric: processing 
will now be discussed with reference tq Figs 2H and ?r. For simplicity of 
cjiscussion, Figs 2H and 21 will be discussed relative to dependent and 




s oftware and f irmwge. .in a stored program gomowtgrj may be impJieme; 
hardware, sucn as with "the arrangement shown in Fig zi; ogjnay be inml 
in combi hatiohs 6t hardwareT timware,. ana software.. For" example, 




procesL^..-, . „ , v ~ -.- - . „ , r - 

Eroce$sing bandwidth operations can b.e performed m firmware, and higher 
andwidth operations can be performed in nardwaf e , . 

Operation proceeds to element 310A, where^ initial point cpordmates XR 
$n<l YR and slopes of the row line MR .and the column pixel MC, ^re 
initialized. The initia l ppint .can .be derived an .response to , translation 
procegsingr such as by adding , the .changes , in translations! position, to th<p 

coo rdina tes qe Uae prifo the coordinates ft 9£ tne next 

initial point . The "slopes of commn pixels 2Ub(J and row lines 2Q5E Fig 2B) 
can ¥e derived in respon se to rotation processing, such as by adding the 
changes in rotational" pos ition to the prior rotational position to oJptain the 
next" rotational position . in a systenf having rectilinear coordinate driving 
functions, the i slopes or row lineg 205E ^nd column pixel? 205C can be derived 
by determining which coor dinate is the independent variable and then 
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by dividing the dependent variable by the independent variable. In a system 
having polar coordinate driving functions, tn^ slope of column pixels 205C 
can be determined by the tangent of the rotational angle; the slope of row 
lmep 20SE can be determined by the cotangent of the rotational angle; and 
the independent variables and dependent variables can be determined by cosine 



and sine functions of the rotational angle and line length. 

Operation proceeds to element 21pB zo test for a frame sync pulse, which 
precedes the start of the first pc^nj-ine. Th^r^fore,^ the frame sync pulse ran 
be used to control loading of initial "conditions for next frame in between 

frame sync pulse is detected, operation^ along the no path to loop 

around element 210B. When a frame sync.pylse is detected, operation branches 
along the YES path to element 210C to initialize the pixel address generator 
to tne start point of the line. This is achieved by loading the XC, YC, and 
RC registers for the pixel address generator from the corresponding XR, YR, 
and RR registers of the row address generator. Therefore, it can be seen that 
the row address generator generates initial conditions for each scanline. In 
a hardware configuration, the frame sync pulge can clock the synchronous 
hardware logic to automatically advance the logic states, where element 210B 
can be implicit therein. n _ _ ^ ^ _. ■ , _ , . , 

Operation proceeds to element 210D to test fop a line, synch pulse, which 
initiates start of .each scanline. Therefore, the lane synch pulse can foe used 
to initiate operation of the Pixel 
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a ddres 




id 

along . 
detected, 

generatic__ _ _ _ , „ 

pulse can clock synchrono us hardware logic to automat D 

States" where " element ~2iqp can be implicit therein . 

Qpe^at ion proceeds to element ^ 10E to test for a clock pulse, which 
clocks the pixel addresp generator tp step along the scanline foj: addressing 




210F to access the present pa,xel from image memory and then to elements 2101 
and 210J to update the pixel address and row address. In a hardware 
configuration, the clock pulse can clock t he synchronous hardware logic to 
automatically advance " tne pixel aggress generator aloncf tne line, where 
element 2 IDE can be impiicic t^ereST . ~ TT, . 

In eletpent 210 f" the aggressed pixel is accessed from image memory, 
where the pixel is addressed by the x£ and. YC coordinates generated by the 
pixel address counter. The accessed pixel can be lo aded into another memory 
map or alternately cap be output. flirectAy to ,a .raster scan monitor " "7TT 

Operation proceeds to element 2 lOG £0 test tor a trame sync pulse. Until 
a frame .sync pulse is detected, operation branches tp element 210H to test 
for a line synch pulse. Until a line synch pulse is detected, operation 
branches along the NO path to 
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element; 2101 for successive generation of pixel addresses. When a line synch 
pulse is detected, operation branches along the YES p^tfc to element 210J to 
terminate processing of the present scanl.me and to initiate processing of 
another scanline. When a frame sync pulse is detected, operation branched to 
element 210A to terminate processing of the present frame and to initiate 
processing of another frame. 

When a line sync pulse is detect ed in element 210H operation branches 
along the Tjo patn J to element "2101 to increment pne "pixel ^Sdaress generator^ 
along the scafiiine Yo "tne"iie^ in element 2101 and to access the next 

pixel in elements 2^e"^ generator is incremented 

by incrementing the mgepengen.t variable, XC in this example, and by updating 
the dependent variable, YC m thj.s example, by .adding the slope - related 
parameter MC to the dependent variable, YC in this example, to derive the 
next pixel address, XC and Y£. . 

When a line sync pulse is detected in element 210H, operation branches 
along tne Yes patn to ^element 510 J to increment "tne row Sddresf generator 
along ,th,e row line to the jieyt scaaune start PQAflt pixel and to element 2 id 
to initi ate ^prpcessing o£ ; tfte next scanXAne: yne row aggress generator is 
incremented by incrementing the indepengent .variable, YR m the example, and 
by updating the dependent variable, XR m t;his example, ]?y adding the 
slope-related parameter MR tp the dependent variable, YR m this example, to 
derive the next row start pixel address, XR and YR. 
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Processing bandwidth requirements are different for different portions 
of the arrangement shown m Fig 2H. For example, outer loop frame-related 
elements. 21QA and 2ILQB . are, executed qn^ejpef ^^P^ H ga^"^s o^cg »Pg^ 
337000-micrpsecon ds : middle loop line -related and 2101 
are executed "once 1 per lin e, sucfr- a s once per 65-microseconqs: an d inner loop 
pixel-related elements "21 QE to 2101 are executed once per pixel such as once 
per u ri-microsecong: Theretore . in tnis example , outer logp rrame-reiaEed 
elementTs have verflQw processing bandwidth requirements anf can be readily 
implemented in Software, miggie loop line-relateg elements have higHer 
------ i dwl dth req uirements and Ca n be readily implement -- 



processing Tbandwigth requirements and "dan be readif y impl emenfc ed in "sot tware 
br 1 1 rmwa re" ~ aj icf " inrifer 1 oop pixel - rel at e~cT elMcs" havp "my cn~ nigKer 
processing bandwidth requirements "and are preferably impl emented in firmware 




flunnc 



gxRcutefl . Theretorg; outer 
timesJQare some of the same pro 
in view ot the foregoing 



will lte rativeiy loop ^rom rrame , co , irame. uoaa^ng ™SSr^r?r... 
Hranslafio naT po^ihipn * will lteraEiveiv JLoop wir.nin^a frame , geneEaEJjag- 
sF.arE :p oi "nf. pfxei address t or eacn 
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row.- and will iteratively g enerate each column pixel address within that row 

t-.o provid e a ^amicaiiy rotating and transiting image. 

A hardware lmpie^ntation ot a translation and rotation configuration 
will now be discussed with reference tp Fig 21, In this configuration, 
translation and rotation are performed with row line address generator XR, 
YR. RR. and NJR .and by column pixel address generator XC. YC, RC, and MC. Row 
initial conditions are entered into row registers XR , . YR , RR , and MR at the 
beginning of a frame and are used to generate line, initial conditions to be 
entered into pixel address generator . registers . X£, YC, RC, and MQ at the 
beginning of each new line After initial con ditions are entered into the 
mxel acfdress generator , thepixel address generator is controlled , to 




scan! ine r "the" line ™s\hicTironizalficatf puls.e~ .incf emeh.ts. The row address generator 
to the next scanline and loads the initial conditions .for the next scanlme 
to be generated into the pixel address generatpr. The pixel address generator 
then proceeds to generate addresses of pixels along the scanline, as 
discussed above. In this manner, the row aad.re.ss generatpr increments from 
row-to-row for each scanlijie to generate , initial conditions for tr*e pixel 
address generator and the pixel generator increments from pixel -tp-pixel for 
each clock to generate addresses for the pixels along that scanline. 
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rated 



ana 
rame 
y 



the pixel slope MC, aire loaded as initial cpnditions for the particular fram 
and (define the rotation of the displayed image scanned- o.ut of image memor 
22 01 relative to the orientation of .the . image m image memory. The 
translational ppsition, defined by the initial XR and YR conditions, are 
loaded initial c.ondition . for the particular .frame and identify the 

translation of the displayed image scanfied-out of .image memory relative to 
the posi.tion of .the image in image memory. Effectively, these rotation and 
translation initial conditions place "a display winaow^oyer the image memory 
map, positioned to the XR and initial point and rotated by the MC andMR 
slbpels "to provide a translated ancf rot ated portion ot tne image m image 

memory , tor "display ~ ~ ~ 7 7. ~ 777 ~ 

Pixel address generator operation will now be discussed with reference 
to Fig 2 J. The independent variable, shown as the XC coordinate m this 
example, is incremented for each input clock pulse to progress one increment, 
such as one pixel, per clock pulse. The dependent variable, shown as the 
YC-coordinate in this example, 15 updated with a fractional increment This 
is achieved by adding the fractional slope parameter MC .to .tfte fractioiial 
portion of the YC register, shown as the remainder least significant pprtion 
RC of the Y register. As the remainder RC builds up with successive adaptions 
of the slope parameter MC, the arithmetic carry frpm the remainder portion RC 
of th,e Y- register propagates, .to the YC portipn of the Y-register for 
updating the YC- parameter . In this manner, the X- independent 
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variable and the Y-dependent .variable are updated to generate a line of pixel 
addresses starting at the initial pixel address for that row and propagating 
with the selected^ slope. 

Row address generator pperation will now be discussed with reference to 
Fig 21. The independent variable, phown as the XR c.oordinate m this example, 
is incremented Tor each input line synchronization pulse to progress one 
increment, such as one row, per synchronization puls.e. The aepejident 
variable, shown as the YR cqordinate in this example, is updated., with a 
fractional increment. Thi$ is achieved by adding tr^e fractional slope 
parameter MR to the fractional portion of the YR register, shown as the 
remainder le^st significant portipn RR of the Y register. As the remainder RR 
builds up with successive additions of the slope parameter MR, arithmetic 
carry from the remainder portion RR of the Y-regiscer propagates to the YR 
portion of the Y- register for updating the YR-parameter . In this manner, the 
X- independent variable and the Y-dependent yarialple are updated to generate 
a line of row addresses starting at the initial pixel address for that frame 
and propagating with the selected slojoe. ♦ 
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compression can be implemented bv a en erahng s a^ T n„ .. 
rfc Chan Ene pix^ei' spacipg'and 5v mixing weighted pixel intensities 



ixels 



ass nf 



non- integer, compression 
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Alternatel 
o peratio ns, sue 




opera 



bed 



ussion h erein. image epmpression may b£ — dASCUSSed — as — & — Separate 

;TfTrvn a I sn ~ for snmpj icihy of discussion herein, image compression may 
iscussed usi 1 ^ a ^horizont al scai^.- which is also illustrative ot image 



compression" implemented" Vrth"~a vertical scan and illustrative ot image 
compression implemented^ w ith an angular (non-vertical and non-horizontal) 



scan . 



Compression can be implement ed by scanning (sampling) image memory with 
more th^n original scaniiffe spacing to subpix^i resolution ana bv weighting 
and mixing pixel i ntensities t& generate new compressed- Pixel intensities to 



3 



3i 



' c om p r ess 



compresgg(?, gucff'ag compressing the image by , .J&x , on% .itexation, then 
gomgressing EHe 90% compressed 3 ^ to glV tor a sepona 

Iteration, and then compressing the 8ir compressea image bv another 9Q\ to 
72 79? toy a tnird f i t erat ion f yiei ding tnrei compres s ions Yor a ? S . 9% 

compression, "This progressive compression can fre~ performed tor many 
iterations. For such V configuration , it "may Be desfrable to store tne 
compressed images each iteration so th at it can t>e again compressed during 
subsequent iterations" such as i with in -p i ace compression or multiple memory 



n one . coQg^^iatio^, 



image . 

- n ~a g c omp x e s s i 



e can 



prog 
;e,rat 



rogressivgiy 



compression 



iterati 
In- pi 



ace compression stores the 
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compressed image m .the same memory map, with the non-cpn\pressed image, 
progressively over-writing or overlaying, the non- compressed image. Multiple 
memory compression store? the compressed image in another memory map separate 
from the memory .map_ storing the non- compressed image, thereby preserving the 

yessioru the sam^ image can be 
Because 




ne image can t>e 

it may not ^pe 

ery one _ ot the 



preserving a non- compressed ltnage T Storage dt" 
without preserving th,e~ non- compressed image can be implemented with m-place 
compression processing. Storage of one op more compressed ipaage&; and 
preserving the non- compressed image can be implemented with multiple image 
memories . . ... 

For a configuration having progressive , compression iji linage memory and 
having overlayed mosaics m image memory; if tne image m image memory is 



compressed and the mosaic t?eing overlayed has not as yet been compressed, 
"here can be a discontinuity in the image. In such a system; a rposai - 
ccessed from th e database* cah be compressgd to the level ofi compression o 



such Compression 

one configuration, 



the image in image memory tor overlaying into image 
can t>e~ implemented in "various configurations, "in 

mosaic can" be loaded into a ftufiter meffiory map and c 



memory . 



The 



compression 
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as a sing 



pa ss 



secause 



r can be implemented as progressive Compression , 
compression involves adjacent pixels, Compression of a mosaic 




border of "the. mosaic. Therefore, a mosaic can ne accessea cogecner witn a 
border of additional pixels, where |he"5order3"ixeX ^ 

at the edges of the mos aic" Then, at tier compression, the boroer Ot ad ditional 
pixels can fa T removeTw the compressed ■ feajo can . be JgeHayea into ^maga 
memor^ j This reduces discontinuities at the mosaic. border . , ^ ^, 




mosaic i n to image memory and compressing the mosaic therein , ine overlay 
mosaic can be overlayea in a region of image, memory not yet encompassed by 
the window. Therefore, proper implementation ,of. such overlaying of a 



non- compressed mosaic , onto ,a. compressed image in image memory should not 
adversely affect the windowed image. Compression processing resources of the 
image memory, can then be used to cofmoress tfie overlaved mosaic to be 
consisten t witTTRe level o| compression "ot the image in image me i?Q y y - 
M * w^,p* r» n for his continuil ieg ^Y~ tne" boundary ot tne mosaic cajy^ 
lisfigd as j discussed aEove for tne Futter mem6ry map arrangement using 
er or ad ditional pixel s: ■ 



;i stent with tne 
iensat;ion tor di 

accomi ^ 

a border of additional pixe 
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Image Expansion 



image expansion can be implemented with pixel replication . For example , 
for an image zonmefl to t wice 1 size, eacn otner pixel can be replicated in 
---- -ss i pHn a Tine and eac K 1 ine can be repli ca&ecT in sue ce s s lefty ~ yielding 
™ nt tour of the same pixels where a single one ot that Pixel 



succession 




replicated in succession, yielding 
where a single one ot that pixel 
g I ternahp arrangement . tne array is 



an a 



oT exp ansion and new pixel intensities are 
and mixed comb ination ot adjacent pixels. 

tractionax 



Weighting and mixing reduces aliasing and perm non-integer, 
ex pansion . 





emented by generating scanlines that are 
s pacing ' and by mixing weighted Pixel 
ine posi tions between _pixel coordinates. 



intensities to interpolate scan line positions between Pixel coordinates 
scanline f spacin g " czfo Be generated to suppixel resolution with the 
incremental g^enerators shown" in frier 2 F. Remainder registers can 
he used to define £ r^ct 1 onai pgr 1 1 ons "of a pixel position and consequently 
-- - be used to determine s ubpix"el weignts . Alternately . scanl - 



can be used to determine s nonix"ei weiatits . Alternately . scanline spacing can 
ne generated ^Tio s^-pixel rejoin the sub- pixels that are traversed 

can oe u sed to detme tne weignts: 



LIS 
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Image expansion can be implemented 



other im age" process lhg dperat 
dedicated 'addres s generators s 



ions 



dedicated address generators scanning a memory map to tne desired expanded 
spacing ? During scinning. pixel intensities can De weigntea and mixed to 
interpolate between actual pixel intensities to obtain tne expanded Pixel 
------- — -ubrPixei — '■ — ' 



intensities to su b-pixel resolution. ~ ~~ ~ ~~ 

ge expansion ca n, alternately. be combined together .With Pfcher 

fls. such as togetner wi tn rotation and translation operations. Tnis 



[mage exp; 



operations,, such as together m 
~ i.n be implemented with, shared 



generators scanning a memory map to 



translalfipn and rotaEi on address gen 

with rotating and translating tne ima t — _ __ _ 

image expansion may be discusse.d as a separate operation. Also,, for 
simplicity of discussion herein, image expansio n may be discussed using a 
horizontal scan: which i s also illustrative ot image expansion implemented 
witn a ve rticaT scan and illustrative ^ implemented with an 

angular (non- vertical and non-iprizontai) scan ~ " 777 

7 Expansion can be implemented by scanning (sampling) image memory with 

less than original scanline spacing to subpixel resolution anct by weighting 

„ _ __. IL __ __^_-__^_--_^-_-- Jt ---- expand . ed . pixel 3ntens1t1.es to 
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non-expanded image. As discussed above for progressive expansion, the same 



image can be iterative.lv expanded for multiple iterations . Because it may nr»t 
he hecessary to rontiniioiiffly store and n fpgprvp each and every one pt THe 

sf- nrea images: iTe. storing a singie exganagg image without ..Pffesfyyj.nq Cfte 
n-PYnSrjS gii imaas or sm rina an expanded image in coffiPination vm 



non-expanded image or 
preservm 



go image or StQEU 

a non- expanded imag 
the non- expanded ima 



combination 
ded image withpu 

. c . , p-place ex.panP3o 

■processing . Storage of one ot more expanded images. and T?res$rviiKr tne 
non- expanded image can be implemented with multiple image memories . Tor a 
configuration having progressive expansipn in. image memory and having 
overlived mosaics in image memory; if the image in image memory is expanded 
and the mosaic being overlayed has 



oring an expanded im a 3 e — 1EL 

storage ot a singre expa... T — 

reserving the non-expanded image can b5 im plemented with ln-place expansion 
a — or more" expanded imaged and preserving ti 
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not 
a s\ 
expc 



In such 
.evel of 
~ ?uch 
iration, 



subsequent loading or the expanded mosaic into the image" memory ." Expansion in 
thThiitlsr mpiory can impleme nted as a single -pass compression or can be 

im plemented as progressive compression . ~ 7 ' ■ . ~ ~ . 

Bee au s e expans *on lnvo lye s adi ac en t ,pix.els, ex pansi on of a mosaic 

without adjacent^ periphe ral pixels can result in a discontinuity .around the 
border ol llie mo ^^ can fte accessed together with - 

Bprder ot acf^ii^ionaTji xels, where the Porder pixel s_ are usefl in expansion a 



the edges of tne mosaic? 'men, at fcer "exp^nsVon . the border or additional 
pixels can pe removed and the expanded mosaic can be overlayed - into image 
memor^ . This reduces discontinuities at the mosaic border . ~ ; 



rife 



pixels are used 
51 on, the £o_rjJe 



Qflit: 



"Rlterna.tely, the buffer memory map can be e. 

mosaic into image memory and expanding the mosaic therein. 

can oe overlayed in a region ot image memory not yet encompassed by the 
window. Therefore, proper i mplementation of such overlay ~ - - 
mosaic onto an expanded i mage in image memory should not 
windowed image . Expansio n processing resources ot tne : 
be used r.o expand the 



.ay mosaic 



liminated by goading the 

" en 

ng c 

ry should not adversely 

resources ot tne image memory can then 



rlaying of a non-expanded 
adversely attect the 
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Qverlayed mosaic to be consistent with the level of expansion of the image in 
image memory . Compensation tor discontinuities at the boundary ot the mosaic 
c an be accomplished as discussed above for the bu ffer memory map arrangement 
using" a border ot additional pixels. 

e images to v_ T . ,__ _ _ ^ r 

e .X34 .,yj:th the^^SLe -- g ^e ^cess^ lor^^oiSing 0 ^^ 

accessed^ tor__ loading. 



t a borde r of additional pixels. , 

Expanding ot large images to view portions pf the images to greater 

resolution can be achieved with the image expansion capability p 

discussed . For example. datiaPase information canoe accessed tor loa 
image me mory and can be expanded to tit into the appropriate reso" 



into 



.on in 



avai 
be 



l lma^g memory .pixel • Th;LS provides tne mgnest spatial frequency 
1 able to the system, as limited by the database resolution. The image can 

be expanded further than the resolution in image memory with 'pixel 

replication? which" provides larger images Put may not increase the spatial 



frequencies nor tn£~ smoothness ot the image 
further then the resolution in image memory with 
the imag e beyond the pixel resolution in "image 



ne image can Pe exfrande 
spatial filtering to_expan 



image bey ond the pixel resolution in image memory and to anti-all 
£n die ^ ge so tMt The pixels are not replicated^ tor expansion 
hted and gfnoothed T interpolation can be used to provide such sm 



_Q_E 



smoo 



weighted, an 



are 



smoothing. 
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Large Image Expansion And Compression Processing 

.Examining pf a la.rge image may involve zoomi ng ou 

portion of the image with lower detail . panning to a' tea — _ — _ __ 

rotating to reorient; th e feature, and then zooming i^n on the teature to 
nore deh 



it to se 
ature, ot 
the teat" 



e a large 
interest? 




o zoom ouE to snow 



t in more detail . in many cases, it wi 
ne tun image on the display: wh^ch. for 
- lion pixel; 



lay; . whu 

i-ftiliion. , pixels compfesged ..to , 3 

undersampiirig may not provide tne dei 
tpucn detail " mq jx introduces unaesira 
latency may not provide tne desire 



can involve 



antaneously , 
it^riooses^top 

-— , ofivention^i disk 

-atency may not provide tne desired capability JDe pause it can involve 
excessive amounts of time to access large numbers of pixels for compression, 



such as requiring about 16 -minutes to access 1-billion pixels for compression 
i * ^ - . ^>--i- — -~ Image co mpression witfh — 

tQ ~^ ' 



ba?ed upon a 1-megabyte disk access . rate 
aliasing could further increase the time — 



image 



r e q u ire*; 



compress sucn a targe 



nti- 




ion 




portions 



e imaggs can 



previously discusse 



or 



examp 
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loading into image m e m ory and can be £g^ r SgggQ Q i.Hf t ,^S! ; .?^?..^£?R^^fri5 
- " - - - - ---ory . fcnen can pe processeo ror compression using trie 



gn^e p 

one "arrangement tor compression , anti-a^iasi 



resolution in image memory, then 5 
image processor under operator con 



a filtering Kernel p 

dimensions ' of tne Kernel 



compression near zhe 'Vxtremes"of ' tne~Tcerriel qr "peypnd "the extremes of the 
kernel, undersampling effects .occur. Overlapping of kernels and shading Qf 
the kernel window may be desired toTreaujffi^ 

a I Ta sing may Be implemen ted with a j -pixel -py- j -pixel kernel OVeriaPP 
nF.Ber kernels By l^pixel on each side VncT sfijjjdea "sc > tnat 'tne pixels h 
lower weights as fiev get furr.fter trom tne center Pixel . ~~ TTT 



.ooi 



aliasing previously discussed uses 
rhts" For compression within the 



ixexs .and , weights. , For ^ compress ion wij 
r ann-liiasma will be most effective, 
£ tne Kernel or peyond tne exa 



,or example. inEE 
kernel overlapping 




ded "so th at 7 the pixels have 



range: i.e.. an un 



-— as "a function of the shadinc 

Knf In TipsnarfeH la^rgeY Ene Full Kern el size may fie Yhl 
shaded 3 -p ixel by 3 - pixel Kernel mav have a, 3- pixel range. 



For a shaded kernel, siicn as a" cosiqe snad^d kernel .part ot the Kernel SXzsl 
may pe the range : i .e." a shaded 3 -pixel Py 3 -pixel Kernel mav have a A- 
pixei range. 




compresse 
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compressed by anot her factor of 2 to l/Bth size m a third iteration. 
tgrtn" tor 'progressive progression during successive iterations 
lEeratiorT pf r for ms " aHti -aliasing yi an" ^ettective manner Sgcaus 




iteration pertorm s anti-ai lasina in an, ettective manner — because — La 
compression tor each iteration is' within tne anti-aliasing capabilities o 
tne Tcernel . In one cont lgurafcion. the number ot iterations to obtain 



, n one configuration, £ 

articulaF degre e of compression wi 



le numpe r ot iterations to obtain a 
ih "aT parti cuiar i Kernel „ size, .can Pe 

>n K=B ^x^opent X. , IS the Size 



alculate d trom 



reduction, i.e. B tor a tactor~o 
for overcoming anti-aliasing, i.e 



toll owing equat i on k=b Vxpbnen 
t actor ot — -- 



i size reduction: B is the Kelrnei range 
=2 £or a j-pixel Kernel: and JM is the 



number ot : compression lt^ions. i . e . n=4 tor 4 -compression iterations . 
example ~. fori : a 3 -pixel Kernel having an effective compression range of . 2 ■ 
times for each iteration and for 4 -iterations, a .compression with 
anti-aliasing of 2 exponent 4 or 16-times can be .achieved with anti-aliasing. 

Similarly, a 25-pj — 1 n ~ J ~ 

anti-aliasing per 

iteration,, a y-t 

reduction in size for 3 -iterations. 




)rocessoi 
frame 




aying a certain pixel processing 
image to l/2-size in l-uflit qt'time. can 
■size in 1/4 -unit ot time, ana 



ompres 



rSfe can 
compress 



heretore. a compression 



compress an uncompresse 
tne'iyj- size image to - 
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can compress the l/4-size image t o 1/8 size in l/l6th unit of time. 

in view ot the above, compressi on processing bandwidth is dominated b 
the ^p-rst iteration and compression processing • bandwidth^tor J s u p fie . auen 



i;xel kernel providing iterative 
compressions to half-size for a 1000-frame image , as shown in t;he le£t hand 
columns of the COMPRESSION PARAMETERS TABEE; the fi^st iteration, of 
half-sized compress lOfi takes 1000-iterations, for reduction of t.he 1000- 
frame s to half-size while all the other reductions down to l/32nd size takes 
only about 332 iteration^ (250 + 62 . 5 + 15 . 625 + 3.. 9063.) . 

Also, for a 16-Dixel Kernel providing iterative, compressions to 
third- size for a 1000-Trame image, as .shown ,m the middle, columns of the 
COMPRESSION PARAMETERS TABLE; the first iteration of third- sized compression 
takes 1000-iterations £or reduction of the 1000-framQs to third-size while 
all the other reductions down to about l/81th size takes only about 
125-iterations (111+12.3+1.4+0.15). ..... 

Also, for a 25-pixel kernel providing . iterative compressions to 
quarter- size for a 1000-frame image, as shpwn ii> the fight hand column? of 
the COMPRESSION PARAMETERS TA£LK; the first .iteration of quarter- sized 
compressign tak.es 1000-iterations for , reduction of . the 1,000-frames to 
quarter- size while all the other reductions down to l/64th size takes only 
about 66-iterations (62 . 5+3 . 9+ . 2) . 
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In view of the above, compression processing bandwidth is dominated by 



as snown in 



The COM! 



the first compression iterations and red^uce^ emonentially as the progressive 

compression proceeds. This characteristic facilitates enhancing of the 

compression Processin g B an dwidth "and the "tim e yequiyea £?X\Jr\ 0 W®^f$ f ilQnof 
large ^images r to smal^ will be Pfoviged below . 

Progissing Fandwidtn reguirements. can .be, reduced by .stormq 
progressively 



_ . _ _ .. ^ression 

iter at i ons" to obtain c om&r e s s i 615 to 1/3 2nd g i z e , Howe ve r, if a half-size 
^ rate d an? — — " — — < 



xress: 



6 r itgra q ^ 

25% ot tne "previous processing Landwidtn ana processin g time . Additional 
memory requirements tor storing "more nighly gompfessed images are relatively 
small, increasing from the 1000 -frame fyll size image storage requirement to 
a 1250-frame furl size plus half-sijse image storage requirement., Therefore, 

a 25% increase m storage capacity can provide — a 4 - fold, , increase .in 

processing spee^ qr a 4^ f<^ 

compre s s ions : Similarly, further pr ogre s s lveiy compressed images can tie 
stored tor still further reductions in 
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processing bandwidth requirements and compression time. For example, storage 
of 1000 uncompressed frames, 250-compressed, frames of half -size, 
63-compressed frames of, l/4-?ize, 16.- cortfer^ss.ed frames of 1/8-s.ize, and 
4-compressed frames- of 1/1£- size permit.s obtaining of any compression level 
down to 1/3 2nd size in binary steps virtually instantaneously f limited by 
database latency time for a single frame pt a "small grQup ot frames. i 

. Compression levels m between these binary compression steps can then be 
obtained with "the geometric processor from tne" image m image memory . This is 
because the image navinq tne appropriate JDinary compression, level can be 
loaded into image memory Trom database memory ancr this loaded image .can then 
ed go any level down to the next binary step size substantially 

progressively compressed images, .in the above 
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Compression from 
---level can be 



performed within tne nex t frame time using tne geometric processor 

• Even with this significant improvement" in processing, bandwidth 
requirements and processing time requirements, the increase m database 
memory storage capacity is small; converging on. a exponential asymptote- type 
of function which may require only a fractional portion of .the memory 
reguirements for the uncompre.ssed image to store pre-compressed images f The 
TOTALS for the START column in the COMPRESSION PARAMETERS TABLE identifies 
the total amount of disk memory needed to store the frames for all 
compyesr ~ J J= ~" ~ ---- - ^ ~ 

331 , , . . 

uncompressed image . 
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[Table from specification herein omitted] 
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The spatial, compression arrangement using stored pre- compressed images, 
reviously discussed, has .profound ^dvan^tages. For example, if a lai — 
image, such as the 1000-frame image provided in "the previo us example, were 



r-r^^, . WWjWg n^me image, provided m the previous e^ami^,. ..^^ ^ 

ne accessed trom image memory and "compressed i: or _ viewing ny an oJDserverT 
processing and compression time would tie relatively long and may oe . excessive 
tor reajl YiWT 0]^ or iuup-rrameg ot 

information for image memory could take <an excessive amount of, time. This is 
because disk memories have data rates in the region of megabits per second 
and a large image may Jiave nearly a billion bits; relating to .hundreds of 
seconds, possibly lO-piinutes, to access 1000-frames of image information. 
Assuming that compression can proceed concurrently with accessing from a disk 
memory and nence not add to" the compression Belay: m inutes ot time are 
clearly excessive in a .system Qontiguitred to operate m real time *. „ ~ ™ 
The arrangement discussed nerein using" storage ot pre-nltered. and 
pre-compressed images can compress from a very larg e image: i.e. r 



lOOO-frames.- to a single frame virtually instantaneously; su ch as w ithin the 
latency - t ime associated witin r^flom Vxess oi: a S3.ngj.e tXSCDS trom d\sK 
memory. whicTi may'Se les s than l-seconci of time, in this example, accessing 
oF p^e - compress¥cL pre^Eirierea image information can provide s macaiit 
a5vantages7 sucn >^ to 55 - fold re duction in time required to compress and 
F ilter a a laroe image to~ , a singTe i ~trame . Storage ot"^ pre- til^ejed . and 
rp-rnmnrPRRPri i^agpX as riiscusseci above can provide real time operation : 



^nmprPRRpy images 3 , as discussed ahpye' can provi de real time operation- 
: =?ven fof compression! from a very large high resolution image to a very small 
highly compressed low 
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Even with such a significant compression speed, enhancement , 



resolution image . Even with such a significant compression speed. enhancement , 
the implementation may be simple. For examp le. ;f pre -compression processor 
can be u sed to pre- filter and pre^cqmpres^s tne image tor storage in IS! 
dataffase . "Th/ siow ~mP speed compared to an 

- Tine filter^ and co mpression processor because pre- filtering and 



on-line filter: ana compression — processor Pf cause ^ . Pre- wtering ana 
pre-comp ression can"b> performed on a "background tasK basis^r such as when the 
Image is" Being loaded into"Ehe dataBase " oYynen the task is . peing set up at 
t he work sta t f on Al s o" tne amoytn t or ex t r a memory needed to store tne 



pre - t 1 l t e r ed and pre -compressed images may be o nly a fraction of the memgr 
gg^M^^m^fe& P m^. SSed is °"™* aeq ^ reference £5 tn 

120 

Composite Geometric Processing ^ , . 

The geometric processing features discussed separately herein; in 

8 articular translation, rotation, compression, and expansion; will now be 
iscussed for subpixel resolution in a composite configuration. . 
. . Translation can be implemented to subpixel resolution by defining the 
initial point to siibpixel resolution. . _ . ~ ~ 

Rotation can . ~E£ implement ecT^o subpixel resolution by generating the 
independent variable to unity pixel resolution and by generating the 
dependent variable to suBpixeT^re solution, where the ratio pt the depende: 
variable si, ope (s uch as" Jess ilnan unityf to"tne independent variable sip- 
(sucn as unity] c oordinates to subpixel -resolution provides an image rotate 
aE an In gleT lmplj.cit in rotation, majjy_pt the new pp-xei coordinates tall 



Between - prior pixel coordinates, where such in between coordinates are 
provided "as the "s ubpixel bits in the rotated x and Y coordinates. ~~ 
Compression can be implemented to subpixel resolution by setting the 
slope or^ tne" independent varlaBIe £o be greater than unity and bv setting the 
slope ot tiie depenflea variable" so mat the^ ratio or tne slope or the 
dependent variabT e to i the slope ot >lie independent variable is equal to the 



Lope ot the dependent- variable so that the ratio of the slope of 
■>pendent yariaBI^ to the slope ot the independent variable is equaJ^to 
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_ibpixel resolution. Traversing of a pixel provides a pixel coordinate 
subpixel resolution, where the integer portipn of the 'X and Y coordinates 
define the pixel and where the fractional portion of the X and Y coordinates 
define t;he offset from the center of .the pixel and hence define the subpixel 
resolution and the ant i -aliasing weights. Because the fractional portion is 
a function of the translation, rotation, and expansion or compression; 
anti-aliasing relative to this _ fractional portion provides Composite 




is not lost, such as wSuld result, from unde.rsampling,- where anti-aliasing can 

cpmbine the effects of such pixels (weighted and summed) into selected 

pixels, undersampling can result 1 tor compression it the amount ot compression 
exceeds the number ~ot pixels containe-d in the anti-aliasing Kernel. For 



, number ~ot pixels cont 

exampie, it the anti-airsing Kernel 
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times or 3-times. However large compression factors can be implemented 
with progressive compression discussed herein because progressive compression 
im plemen ts comp ression by a relatively small compress'ion tactor "that is 



performed 1 teratively to o hf.ain a relatively large compression factor . 

The arranqement shown in fig Sfl Has Been ciis cussed tor. rotation and 
translation processing without expansion or coraprespion processing, gxpans^pn. 

1£L " """ 



summer jLn_ coniu: 



sJlop 



3- on 




e register ann a' 
m the same 



:ne depe nden 



manner 



hat .a 



er ana a summer are 



I 



yariaSie register, in tnis manner, 
rn progress 'with a step size pthei 
compressi on ana less tnan unity tc 



nan unity. 



compression ana less tnan unity t ox expansion . T n< 
E KpT dependent "var 1 abl e need riot Pe changed bu£ 

vag awe jo th^ saouifl Pe~ 

rotat i on desirea ■•" 1 . e . to tne tangent ot , tne rot 



the rat 
set to 



reference. to Figs 



_ — tangent ot tne rotation angle: 

Expansion and compression w3,il now £>e. discuss.ed. witn7rc . _ 

2i and 2K. Figs 2J and 2K shpw integer pixel positions in the y-direction 
with solid lines spaced apart in the vertical direction and fractional pixel 
positions in the Y- 
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direction with dashed lines spaced apart in the vertical .direction. 

Fig 2 J shows a .Y- independent variable progressing. in steps less than 




in . the first pixel to a 0 . 50 -fractional position in, the. second pixel, .the 
third steps progresses frotr\ an 0 . 50 -fractional pQSition in the second pixel 
to an 0 .25-f ractional position, in the t*urd pixel, and . the fourth step 
progresses from an Q . 25 -fractional position ^.n the .third pixel to an 
t) . 00 -fractional position. Thi? involve? 4 -steps .of the independent variable 
to traverse 3 -pixels, thereby implementing expansion. The fractional position 
within the pixels can be usea for anti-al iasing processing to provide smooth 
continuous 'expansion . ~ ~ ~ ~Z 7 . ^ _ 

Fig 2K snows a Y- independent variable progressing ii> steps greater than 
unity with dash lines, 1.25 -pixel st;eps, for compression, The first step 
progresses from an 0 . 00 -fractional position to an 0 /25-f ractional ppsitiQn.in 
the second pixel, the second step progresses f rQm .an 0.. 25-f ractional . position 
m the second pixel to an 0 . 50 -fractional position, m .the thirql pixel, the 
third steps progresses from an Q . 50 -fractional position m the third pixel to 
an 0 . 75-f ractional position iji the fourth pjixel, and the f.ourth step 
progresses from an 0 . 75-f reict^onal position in ! the fourth pixel tp an 
0 . 00 -fractional position. This involves 3-pteps of the .independent variable 
to traverse 5 -pixels, thereby implementing compression. The fractional 
position 
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within the pixels can be used for anti-aliasing processing to provide smooth 



compressior 
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Address generator scaling . . , . , , . , 

An example of address generator scaling will now. be provided with 
reference to the configuration shown in Fig 2L. For convenience <?f discussion 
this configuration ig shown with 16-bit registers tor the X-reaister and the 



i 



-registe 
-Qli 



ontigurarinn is; shown naviria a-nics ot integer 



so. tnis configuration is snoi 

resoxut;ion T and T^bits ot, tractionaj, resQJ.uta.Qn. . ^ ^ „ . . , 
Fig 2L illustrates trje scaling tor the x-register ,. the Y-register, and 
one .slope register.. The integer portion of the X- register and Y-reaister 
provides^ 9-biCs of pixeTg esc^ltiorf tgr a^refffifrng X-^XKQX gut Qt. j^j-g^x eAl 



one .slope register.. Tne integer portion ot tne x-reais 
provides^ 9-biCs of pixeT^ resnTutiori tor addressing i-pixe 
in the X-direc tion and I-row out ot 512 -rows in 
respectively" Mi l s provides tor addressing all or tne 
5lZ-pixei "by 5 12 -pixel" memory map witn tne integer portion 



respectively Th is provides for addressing all ot tne pixel words in a 
slZ-pjfxei by 5 12 -pixel" memory map witn tne integer portions ot tne X-xegister 
arid ^tne T y -register : ~rne tract I^nar portions 6F tne register and tne , y- 
register relate ho subpixel resolution. Tne most significant tractionai Pit 



-floret . 
words in a 



ion, 



represents hall 



f 



represents quarter-pixel re 
bit represents eianth-pixel 
A" representative "slope 



ortion pi 



A representative slope register is shown with a 2 -bit intege: 
and, a 7 -bit fractional portion. The 2 -bit integer portion or t 
registers line-up with the least significant 2-bits'ot tne integer p_ — 
tne x- "register 5nd the ^ Y- register^ and" tne 7-5it fractional •portion of tne 
sl o pe re g is t er s l ine - UK > wi th tftg~y-tiit tractionai portion o£,the x- register 
and y-re^ster^ as the" slope register parameters 

are aflflea to the ^-register ana ZE 
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reg i s t er , th e maximum , up date per iteration is ^almost 4 -pixels £or, almost 
4-time s cQmpres sion a^ iteration ig A exponent-7 teg 



very large ex; 



ion 



in view of the above, the parameters m the slope registers are "adgled to 
the parameters in the X-register and Y-register to address the next pixel. 

The independent and dependent variable arrangement discupsed with 
reference to Fig 21 will now be addressed. For the independent variable r - the 



larger the number in th e slope register, the more compressed will be the 
image, and the ? small srW njMer in fctie slope regi Ster." th e ^ O ge jexpariaecl 

,?t-; J_J pe tflP "■ m=/-ra wr\r FTvS -i nHononrlOTit- varTahTp a nrnrv 1 nrPCT 



e tne ^aae ""&of'the"'xnciepenaent: variable, a unity integer in the ; .slope 
wipi unity size transformation. a 1 



register provi 



- . _ provides compression . arid a number less , than , Uhitv in the 

slope register proviaes , e^ansignT For .the dependent variable . tne t^ggr , the 
number In trie slope regis ter, tne greater tntf rotation angle ana the smaller 
^ _y»w._ vty^ ^y e "^ qis ^g r ^^gKg^s ma xier tne rotation angle. For the: 



the slope registers 



s5^j?e regis 

a ze ro, 
zero lr 
is para 



^ in the slope register (an ail zero fractional 
nteger p ortion) provides g zero rotational ancle: 
il Tel l:o t ne coo^inate axi s or the memory manl" 



tract 



tne number m tne i 

dependent ^variap,!,^ , , 

wnereTn e gcanii 5 ^ iV "parallel" 1:0" tne" coot^inate axis pt tne memory \?aPT 

The address to. Fig 21 an$ Fig 2L A 

will now be discussed for the detailed logical implementation shown in Fig 60 
to 6R. Four address generators are shown implemented in Fig 2 % 1 ; the X- row 
address generator, the Y-row address generator, the x-pixel address 
generator, and the Y- 
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provide various gepmetriC, capaSiliEies 

expansion, compress,! an, ju-perspect 



5 , 

example, "counters may be used for the 

from pixel -^Q-pixei. as tne .image is jj< 

do not nave tn e flexibility of th 



— . _— ipression. and 3U-perspectiye . One configuration uses .aggress 
generators f or > and aggress ^ a slope parameter with gooc 

sub-pixel resolution . jFn^is "taciIi£ate 

and Compression capability ^ Alternate configurations ma^ 



canned- ou 



5SS 
Q-out 



enerator to 



a y courier configurations 
^ 

adequate tor some applications - TTT , . . 

A hardware configurat ion " is provided herein for .generating addresses . to 
access image memory and to perform post proc.essincr on the information 



on, expansisr 
u T5e used. For 
date the address 



do not have 3 £ne tlex^bjlj^ 



accessed from image memory for real time operation. Alternately, sof twired 
- rrangements can Be provi ded for other applications. such , as for npn- rea ' 

lme applications and such as tor applications having lower cos 

eq ^ire me m a • such 
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applications, can be implemented under software control, such as implemented 
m the software emulator previously described. 
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Image Warping 



th e^corVe sporidi^ gfaPtjjl 



as witn. lens dist ortions, can oe corrected^by warping to an undistopeo! torm: 
warping can be used to compensate tor characteristics ot equipment, such as 
compensating r ior perturbations in a video scan by warpma "tne image in the 



[mages tnat aire dis 



reciprocal n difectfoli ."l^arpThg'can^be us 



a 



so , scanpy .warpinc 

d to provide JT)-p 
i tne- address geTi 



2T£ 
IT 



ima< 
dis.cus.se' 



ige warping can be "implemented wit 
d . modit led r or nigher- order tunc 



no 1 pixeF aaaress generators i nave r peeir^ QiscusseQ tor prbvicl: 
irst- order curve along a scam me through image memory. Alternately, 
canlme can be controlled to tollow a - nigftef-order "curve through 



erspectiveT 



ion generatio 



ors previously 



exati 



ScariJ 



r curve alp: 
an pg gong 
ida pting the 
IT trie addrl 



emory"riy "adapting ""trie ""adcffeslT generators tb z trace" out higher order curves . 



I 



jacn 
image 



ddress generators" can generate seconq-order . 

= mna .n.n -order , "curves, ana .can even generate cue ^_ 

sinuspidal. arc -sinusoidal. tangential. arc- tangential . exponentia 
aigoritnmic. and other mathematical" and non-math ematicai functions 



lrq-prder . 
curves tnat are 
1. _ exponential" 



or example, 



ms 

le address generators, previously discusse 

multip le orders of operation. The z^ro-or 

defined point, stored" m thi 
conditio ns The tirst-i 

the get med poinE 

130 



and nc 
sly di 



in the X and Y pixel a ddress registers as initial 
order can be considered to Pe tne "slopes that update 




change register can provide the change per iteration in the next lower order 

n9 fn^an*ilf ernate configuration, an e quation can he implemented .- such as 
the equation A + Bt + Ct * Dt .. . . having a constant term, a rxrst-order 
term, a second-order term, a third-order term, and higher -qrder terms with 
related coefficients. This equation can be implemented in various forms, sur.h 
as in an incremental implementation : Tlie sglu^tion ot this . equation can_jje 




warping geometric p'rocessor. 
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The warped i mage can be translat 
otherwise processed t 



cislated 
qe a 2D 
stem, tr 

addition 



.. . . , . . . „ ^ _ imag e wrapped on a AD surface 

in the experimental system, the address "generati 
(Figs 60 to 6R1 can be upgraded |o groy ide warping c 



^n X and Y. can be rotated, and can be 
image wrapped on a ID surraceT" 
he adqress generators qn . logic board BL1 



:o provi 
ital 



llity • This can be 
regisEers and add er s, t S2Z 



computer ^r^o. EHe pixel slope ^registe rs rifay Have ITi ope gutter registers 
that "are load once per fr ame by the supervisory processp-r tor reloading the 
pixel slope registers each line. ~ \_ ~ 7 ~ , , , 

The fteiEa-slope regis te rs~ean be characterized as a second-order slope 
ter; which carf 'be TupQaEea to h igher orders, sucn as a tnira-order ana a 



ourl:h.^order . The del ta^ slope r^gis^ers "iF they store constant parameters 
or a second- order correction configuration, need not be upda.ted bu.t may be 

;onstant. Alternately, in a third-order correction configuration. the. 

ond-order delta-slope parameters can fie updated by third-order 
------ -- J "- £ne delta- slope registers are updated 



■sh carf be updat 
The delta- sLi 



5tc 



a cons 
se 



n _ __. _, -he warping capability can, be performed by adding 

delta- sloge registers for a second-order correction and a butter register tor 



storing the slop e 
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parameters . The slope parameter can be reloaded for each scanline. such as i 
EEe qanner t.hat the plxeT positipn registers are loaded each scanhne. Thi 



the manner that the pixel position registers are loaded each sea 
can be performed tfir the" pixel address generators, or the i 
generators 7 or both the pixel ana row address generators . ; ~ 
Tne higher order slope configuration can rpe placed gn a singl 



in 
.s 



or the row address 



as 



chip with the geometric "processor /becaus 



inputs an d bgcauTe Key rg^ifg only a smili amount ot: additional circuitryT 
inputs can be li mited because the higher-order warping registers can Be 
oaded over a shared com puter bus and 'the processing can be performed in 



requi 



igle custom IC 
re additional 



pinouts 
Pinouts 



loaded over a 



conjun ction with the'addrgss generators that are on the same chip. 

The experimental system ean he easily expanded to add additional slop 
resolution. Ynis "addition al resolution can oe lb -pits, lia-bits plus sign, t 



herein wi 
8 -bits of 



its plus sign, , 
>iier . As discusse 
e implemented wit 
.on p~ius s^.g^i Thi 



leaves 4-Biti 



ytes are 



presently used) . Slope re gister loading can fee increased from 6 -bits pgr byte 
to 8-bits per byte : witho ut addi tional- computer processin g bandwidth" because 
the computer is" processing a lfa-oit integer word and is outputtmg z. B-bit 



the computer is" processing a lfa-oit integer word am 
bytes t5r the configuration shown in Figs bU to bk. 
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re presenting 



line 



aggresses" can be implemented. 3.0. 
appropriate scanline, star^ 



a, cir 

ilar t 



circular 2JM 



ernateiy. 
to give 



row 



rcu 



orm 



ler form 



,q gyve the 

or. the row 



pints, For 



gener&tor"cah"gehefate~a" start point address along'a "radi 



.aunteax rat 



e through the 



circular scan, - pixel address generators can Ijeinfeerconnectert therepetween as 
a circle generator to generate sine and cosine parametric equations ot a 



circle.- with the slope registers being updated "from the overflow of the 
orthonpgal pixe l address registers. A circular address generator can start 
with the innermost circle; at the center ot the scan and generate circul? 
scans radially outwar 
circular scarfs outsi - 




radia lrj DP 8fe^aSove" 1 the r.ircle address gene rator can be used t 
rectilinear image into a circular image in a retresn memory t_<_r re 



9 map a 
:1 restimg 



the display^ 
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Foreground And Background Tasks ^ . . _ 

The geometric processor can perform dynamic processing as both. 
foreground 3 tasks" and ^acTcground tasks . Signals-; needed tc » ret regfl a fl^SPlav 



tsjcs in 
d as ~p; 




acicgrou 



ation. 



nrt tas KR^in near real-time 
rotation , and _ anti-aliasing. 



zg_ 

occultin g, data decompr 
processor is pertorming 
tasks ca n be executed c 




on a 



oreg_roun 



eometric 
e the 



anti-aliasing pixels irom 
ween processing ot pixels 
orm com press ion /expansion 
by scanning through image 




mi 



rocessing on tne information" in image memor 



ge memor y by scanning through image 
1 able bas is ana compressing tne image 



emory in "non-reai time on a time avaiia 
therein. 

. Time may 
periods tor " 




be avai lable during line sync periods and during /frame svnc 
background^ processing : Alsq, time may be available during 
Messing durijig p ixel processing periods", permitting concurrent 



rid processing duri ng pixel processing periods . permitting concurrent 

ne t pr Qcess^g. For ^example; pime- may r ~be attiXaPxe V "cQipgiaaa 
is fn image "memo ry during eacfihorizdntai and each vertical svnc 



fn image memory during eacn norizontai and eacn vertical svn 
time may ae ayaiiaple to compress l -pixel in image memory durin 
Erne i pixel period. Assuming that image memory is 4 -times as iarg 



acn real time pixel period. Assuming tnat image memory is 4- times as large 
s trie window, s^cn background processing would need only a tew trame periods 
o compress a new image "into image 
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memory . If compression is a gradually progressing operation, any small time 
domain discontinuities may not be apparent to the observer. For. example, if 
compression is progressing afc a twentieth of a ^lne^ per frame_ period. , 4 -frame 



ot about a 



a , line. I_D 



eriQds wquj 



involve a 



■s continuity 
tittn ot a . 



ot a line each tour trame periods, abou 



anTipn ot a Second, would appear as continuous motion, 
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res si on. Qt.a 



Virtual Scrolling And Wrap-Around 

- crolling can ] J 

or example, g 



Virtual scro lling can prpyide continuous ' seamless' motion over a very 
.^mageT For example, a billion pixels can be stored in tne database in 
■C Toil , Mosaics can Be accessed trom tne database ¥_4A as needed in 
accordancewith geometric proces sing and overlayed in image memory 204C. such 



large image 
mosai - 



configurations; , dyer laying ja eed only be Tperto 
with translational rate . thereby simplitying t;ne da 



ahd"t a"c il ^t at lng" "cont" iliuou~s" morTioh" witn~ uhTifni ted Branching "capafeil "i£yT 

a fast random access stolre for , image 
environment can be stored as mosaics in 
tne database can be resident in image 
as motion, o.t the display window causes tne 



reb 

_T__ 



,g the, dalaBai 

L^nited branch 



■ ow rate consistent 



se memo 



j_j__ 



interlace 



:aciiit 
As tn 





s window mot ion pas s e s the edge o 
• ' - ' mempyy sontai 



an edge of. image memory, new mosaics can be 
_ ^nto available ^ - 



ove 



&SF§r 



portions ot imag e 
:h"e window can wrap 



memory . 

around t o the o 



image 



the image tor "seamless " image continuity 
scrolling^ 
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_ _ _ ______ memory , the window can wrap 

he other side hf image memqfy cqntaifling the continuing portion ot 
tor "seamless" image co ntinuity. This will be termed "virtual 




i-uiiiiun uiAci o , x.c. a_uut i,uuy iu_ _t_ uui ., , 

disk can store up to 1/4- billion pixels,- i.e. about 1,000 medium resolution 
frames. In many Applications-? . tfre flat-abase access rate requirements are low: 

time to translate an image across image 



such as JMancT 
memory This — 



Cn many applications, 
l>eing~ gg-erminecrffl 
This pe u rmits low ac* 

_e, to be used tori 



lermined by tne time to translate an image acros. 
rmiYs lo w access rate memories, such as a sequential access 



yicteo" tapa 



_ _or image storage . . . 

Operation ot a window] moving Yelat iye_ to an o image memory_ has Jbeen 



>reviously discussed, such as relative to Figs 2A to 2E. _. 

:oward a boundary of image memory ani^ crnsges that houndar 



s the window moves 
a wrap-aroun; 



metric processing 'wit 



205K, 

wrappe. 



aries . For. example, ____ 
in a particular direction 



:nce to Fig _B; tor translation ot a window. in a particular direction 
the wind ow may cross a boundary 205L of image Tnemory. 205B. may be 
d- around to tne opposite boundary 2C)Sm. may translate in a direction 



2 0 5K toward the same boundary 205L and again cross the same boundary 20 5L, 
may be wrapped around "aaain J to the opposite boundary 205M, and so forth . 
Mo saic elements 'trom f.he ; database ran he pverlayed af: the opposite boundary 
•AOm from wKlcTi Hie T window is moving away, ^itereFore . an observer viewing Eng 
image through the window w ill view a continuously moving image as the window 
wra ps -around to t he new mosaic" overiayed on the opposite PQunuary ot image 
wpmKry^ s!Tmi riafiy. r nfahnn and expansion may cause the window to move past 
aTiouBdary of ima g e memory, wnicn can Be accfrmmodated bv virtual SCroJJJLng . 
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Window motion, such as horizontal and/or vertical translation, with 
wrap-around may be characteriz ed as a form of scrolling, horizontal scrolling 
and7or vertical scroTIing: SucH wrap-arouncf motion "together Wftpn overlaying 
f rnm a database may be"cnarac t erized, as ^virtual "scroll xng" Tms pemitB , a 
relatively Faroe i mage to Ee~ implemented with a relatively small image memory 



relatively large im age to pe implemented with a relatively small image mgrnpry 
by overlaying Yrom TTie database^ and by wrapping- around' image memory as the 
window c rosses a boundary ot ' image memory . ~ ~ T TCVrTMr , 

Wrap -around is discussed . with reference to the BASIC PROGRAM LISTING 



DIS.ASC provided herein. Portions of the window and portions of the image 
that extend beyond the boundary of. the. image memory are wrapped -arpund. For 
example, a test is made to determine if the Pixel coordinate is within the 
imagfe memory boundary , it is. th e pixel: is QisPia yeq at the pr esent 



g niindarv. The wrap-around ^ ift the BASIC! PROGRAM LISTING 

TS . ASC provided nerein is executed independent ot whether wrap-around occurs 
as a result "ot rotation, transl ation, compression, or expansion or anv 
combinat ion thereof . ~ , ~~ . 

Wrap-around is shown implemented to^ wrap-around imag e memory, .not 

database memory or the output window : Xn an alternate configuration, 
wraparound can pe implementea tor the database memory or the output window 
in accordance with th§ teachings tor wr ap-around m image memory 
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Spatial filtering involves weighting and summing of adjacent pixels. 
However, pixels at tne boundary of^ the memory map may have some pf the 
adjacent pixels wrapped -around. One arra ngement for spatial filtering of 
pixels, at the boun dary of the memory map is i:o access adjacent pixels, which 



OH of t he memory map would access more positive adjacent X- pixels from ER6 
pixels a t tne ^ nVgatffye "g-Rounaary Tfdcj^or tne metriory map, "a pixel .at the 
negative x-bouncfaW 3 log ot tne J memory map would access more ..negative 
t a cent X-pixeis rrom the pixeisaT- the positive X-boundarv 310H Ot the 
:mory map . a pixel at . the positive T^-boundary 5l6I ot the memory map would 
ices-s m^eWiT ive i adfacfat j-pixeis rrom tne pixels at tne negative yrf 
lundary ilbF ot the memory map, and a pixel at the" negative y- boundary 31 07 
the memory map would access" more negative Y- pixels' trom the pixels at the 



adjacent 



memory ma; 

rjounjar^ ll)^ ~ an5"a~pixei at tRe^ negative^ Y- boundary 3 1U 

ot the memory map would access; more negative Y- pixeis'trom the pixels at th 
positive Y- boundary 3101 ot the memory map. : 
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Clipping . , . 

.The image processing system can be implemented to automatically clip 
portions pf the image that 'extend fteyond a~ boundary. For example, in the 
configuration shown 'in Fig JET, when window 2 05A extends outside of image 
memory 20 5B, clipping can be implemented as an alternative to wrap-around and 
virtual scrollin g. .The portion" ot window 2U5A ext 1 ' 1 ' ' 



rernative to wrap-around and 
:tending beyond the boundary 
jh wrap-around and virtual 



ot image memory 205B can be clipp ed Although wrap-arouno; .ana; virtual 
scrollin g may be preterred tor many "applications : clipping may be pertinent 
tor certain 'applications, such as 'applications that do not have a" database 
image to implement virtual scrolling "or do not need wrap-around capability. 
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Relative motion 

Motion of an image can be defined as being relative to the reference of 
the observer. For example, for CCW- rotation as view ed by the observer at the 
viewport the scanlines are rotated in a cw-anguiar direction to provide this 
visual .ettect . Theretore, the .sign associated" with t^e slope parameters may 
be implemented as negative signs relative f.o the viewport Reference . for 
example, tor coy rotation in tne viewport it wquid appear that a positive 
XP-slope is needed tor line direction 'and a positive xk- slope is needed tor 
L-cw- rotation. However. ccW- rotation as viewed 1 by an op server" at the viewport 
can be implemented with cw-rotation ot the window about the image memory. 
Therefo re: a positive XP-slope and a negative XR-slope can be used to 
implement CW-fotation o t the' window about th e image 'memory to provide 
ccto- rotation to an observer through the viewport . 
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Joystick Controls . . 

Interactive real time operation is demonstrated with the use of joystick 



controls. T he operator can c 
and expansion/compression wi 
Have bee n implemented, for 




grovidea nerem. 
oard joystick controls will now be discugsed. . Kpyfroard inputs, to the 



piB p Ky*^ rssp3ngive to Tem^naX Key^aag: 

Key-1 through key-8 representing +x, -ftr -X" ; + %< e ^ n ^ Q ^^^ c g^^HiSS ^ 

+ahgler and^-ang^ The -X' -Y, and +Y" cpmmana^ 

are translation acceleration commands; incrementing and decrementing the 
X-delta and Y-delta velocity parameters in response to kev actuation. The 
+anqle and -angle commands are rotation acceleration commands; incrementing 
and decrementing thq angle delta velocity parameter in response to key 
actuation. The expansion and compression commands are scale factor products, 
decreasing and increasing the image scale, factor respectively by a 
predetermined factor m response to key actuation. 
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-ypp controls Tt 



Joystick key signals are multiplexed into a single, serial port used f pr 




of x- tran slation. Y- translation ^-rotation, ana expansion /compression to be 
perfQrmed in acco iffiancp with the previously generated sequence or commands . 
Continued depres sion ot a command key causes a more rapid command rate Tor 
tKat tun ctioft: spcn as ^ n^ n r|te qe the cpmmaffd ^parameter. s^rpKe 




de pressi on ot a Key. wit^ouV continued depression o 
p^ecis|iy controllable incrementaj. command. ^For exampli 



+x~swi£ch results in +x motion ot a comman 
ot tne -X switch cancels X-motion and resu 



ey, .provides 
re-ssyons -~ ' 



n 3-gepressions 



amou: 



„ cancels x -mot ion and results in zer 

Analog j oystigk control wii i~ now ce discussed . The analog joysticks 
include 2 -Separate joysticks, each having 2 -orthogonal axis ot control. Each 
axis ot ejoncroT is implemented with an analog potentiometer in the loystick 



-axis motJLPBu ^ . . 
he anaiog^^ 2gy st jLCkj 



and ~a£ AD(^on "the" rear-end Soar 

convlrters . 1 __ _,— 

-X^ V +y. and "-"V 15bninand$" are" tf ansiatTon "velocity" c'ommandsj updating" the' X 
Y position parameters in resppnse to -joystick commands. The +angle and -angle 
commands are rotation velocity commands; updating the ang,Le parameter in 
response to the "joystick commands . The expansion and compression commands are 
scale faqtor products, updating the image scale factor by a factor related to 
the magnitude of the joystick 



mrroi is "implemented with an analog potenti o meter in the ioy„ 
: on the T rear-end Poard Ml (Fias jT to b v ) . The software initiates 
operation and thenT" after a period ot time. .reads the output ot th e 
i as indi cative ot the magnitude ot each ot the loystickS. The +X. 
d -Y commands are translation velocity commands; updating the X and 
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command . 




initiated, can be increased in rate can be dec 

stopped by manipulation of the +anaie and -angi"_ 

joysticks : Also," positive and negative x-transration an 
be individually and in combination increased in n 
stopped py manipulation ot the related switches 



Efiaaec 

e switcl 



in rate, and ca 



sea E~6~ emulate 



ranslation qsz. 



be^n^ividually and m combination increased in rate, decreased in rate, and 
stopped by manipulation oTlne related used to emulate joysticks? 

simiiarry. expansion and compres sion can te commanded to increase image size 
and to decrease image size." 



145 



Experimental System Video Tape 

Video tape recordings were made of images g i enerated with the 
experimental system moving under j oystick control. Video tapes haye been 
filed m the disclosure doduments 1. Disclosure Document No. 126,923 filed on 
March 19, 1984. 2. Disclosure Document No. 126,825 filed on April 26, 1984 . 
3. Disclosure Document No. 127,956 filed on June 4, 1984. which are herein 




brilliant, .colors , o£ the display .processor display cooler not be recorded in 
tuil detail or c olor j je e wse ot-Xitfe lower jesoXutiQn^anfl lower quality of the 
video camera and" video "t ape. However . tne recorded quality is adequate to 



video reamer a and' video 1 : ape "However .line "recorded qucdibv is adequate "to 
demonstrate actual reduct ion to practice ot ^dynamic reaT time operation under 

operator " control with simultaneous rotation, translation, and 



expan s I on / c ompressi on , 

The video tape r iled as Disclosure D.ocument No. 126,825 will now be 
discussed, which is generally representative of the other two video tape 



disclosure documents referenced 
blue background using_ a_ version^ of 



_hese images were manipulated under 

dynamically rnqving images. Motion is shown to 

-, ^ Aid images are shown wrapping around. Tne more impor 



herein 

dynami 

real time 



, n tq provide 

smooth and contentious in 
rtant images a?e 



images that are m between unity size , and medium g^a ns^on; becawse images 
ougside of this" r%e nave aliasing etFects" resolution e ttects. a nd other 
effecEs that detract' trom 
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appearance of the demonstration . However, .presentation of these effects 
illustrates characteristics of the demonstration system and shows extremes of 
operating parameters. n , n . , . . * ^< 

* ^-^ — — sanded to large size, aliasing effects and discrete 



slope . registers than available tor more compressed images . aiso, sych 
expans ion exagger at e s pixel resolution in. image memory; presenting 
exaggerated aliasing effects, such as staircasing. 

As images are compressed to small, size relative to image features, such 
as compressed bar patterns tp one pixel width per bar or more compressed 
therefrom; exaggerated aliasing effects are introduced, such as distorted 
oat terns 

Simultaneous motio n having combinations of X- translation, Y- translation, 
rotation, and e xpansion/ compression are snown in real time with smooth 
conEinuous motion Speed ot motion is shown .ranging trom very slow motion 
conEroIIeci by sm all * displacements of the joysticks through' fast motion 
controlled .by large displacements of the joysticks . . . ^ _ 

Blanking , which haS been implemented with blanking signals. to the DACs 
on the rear-jjnd board BR1 , has be% m odified to show the images in unblanked 
form . The effects that are blanked during usual operation are visiD+e here, 
including distorted image effects around the , periphery pf the viewport, 
characterized by the distortions at the far right of the viewport. 
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Expansion arid compression are usually limited to a range consistent with 



the nature or the images to mini mize the etfects of aliasing. However, in 
order to T demons t rate tne?e ette rls. expansion and compression nave been 
extended faqyond these limits, The ettects ot compressive aliasing, such as 



ressefl . For the single 
wide . red/ green, blue, 
- -"" - asing can be seen 




magnit led "to larger s i |e. " , j~ ~~ ~~ 

For the configuration of the experimental system used to generate the 
video tape filed as Disclosure Document No. 126,825; X- translation and 

Y- translation are refere nced to the image memory. not . tQ .the . viewport ■ 

Therefore: rotation ot "th e viewport causes~ rotation relative to the X and Y 

j oystick conty ,Qi a jare.reiSQlyed into viewpQEit coordinates so that the joystick 
controls remain tixed to the viewport while the 
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jjnggg.. is being rotated _. Representative equations are, as follows. JSXR = 
JSX*COS CAR! + JSY^S JMCAR) JffYR = jJSX*SIN(AR) .+ JSY*COS (^R) 

, The color monitor is a medium resolution coipmercial quality monitor 
having good spatial frequency response and having brilliant colors. The video 
camera and video tape recorder .used to re.cora these .images are consumer 
quality units and hence result m degradation of the images. However, the 
image quality. is sufficient to demonstrate . an actual reduction to practice of 
the features implemented m the demonstration system. The full quality, of the 
images can be obtained by one skilled in the arjt by constructing the 
demonstration system according to the teachings herein and .by operating the 
demonstration system m accordance with the teachings herein.. 

The images portrayed on the video tap e provide demonstration of many of 
^| n | f^^ s " dls ? u ?seci; he rein in variQus gopiKinati pns and with many qittefenf 

demonst]^a 
motion foy 



:he features discussed her ein in various C ombinatio ns and with many 
scenarios" to establish a ctual reduction to prac tice over a wide range oi 
lemonstratable sce narios .For example, the demonstrations provide 



Die scenarios For example, the demonstrations provide rotational 

. _ many git terent con jitibns ot scaling . x-position. and Y-oosition 

and provide rotat ional motion in combination with expansion and compression: 
m comb^natign with X- translation: in combination" with Y- translation: m 
combination with expansion and X-^ransiatign: in combination with compression 



ombinati on with expansion and X- translation: in combination with compression 
nd X-fcransiatio n: in combination wit h expan sion. x-transiation. and 
-translation: and with other combinations ot fettects. 
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Also, the demonstrations provide transl ational motion for many different 



conditions 



trans la 



compina 



tions of scaling. X-positiqn. Y-position. and rotation, and provide 

:T af i onaf moTi on * in Minal -Von jffifcTi expansion and cdtnor es s 1 on • in 
nation wiE.fi roEafci nn in r nr^inahion wiER e vngnsipn ana Yoliiion : in 
naFTnn wfrffi rnmnrpssi on a nd roE aE ion .• an3 wi£K cfc h er comBiniEions of 



jpansipn and r _ 

th other combinations n 



mation w itn compression ana rotation; and__m 
cts 




V- translation • in comD i nation with rotation and Y- translation; in 
nomination ^ 



The in&ges Wrpraygg on the video tape demonstrate many sequei ^ 
operation VorexSmpTe . tne loysticjc s were mani pulated in a circu lar rasmgn 
to provicis "sequences of plus and minus x and Y motion an d to Provide 
sequences "ot "expansion and compression and plus and minus rotation^ _TH r 
rpsnonse ho tfief fovsTicic rinanls anfl Ifie 'sequence ot operation can. 



uences ot expansion and compressio n and P lus and minus rota tion. The rapid 
pon se hg i t-M ^oy^-V^^ ^P™ 1 ^ an ^ ^fre sequence ofc operation can be_,s&en 
im the vi deo tape playback: . 
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Other Geometric Processor Configurations . 

Various configurations qf the geometric , processor of. the present 
invention have been ciiscussed .with reference to Fig 2 above to illustrate how 
the various features and devices of the geometric processor .of the. present 
invention can be used to implement a system. These configurations, are 
illustrative of a large number of other configurations that can be 



implemented^ trom tne te^liinas^erein . ~ ~ T TT '. „• , , 

The i dit terent geometric processor features disclosed herein can be used 
in different combinations and with different interconnections, illustrated by 



in the configuration of a window configuration. This wmdpw configuration is 
illustrative of other configurations that do not use a window architecture . 
For example, a plurality of address ge nerators can be used to address a first 
memory for acces sing pr pixels ana tor writing lflto .a_segong^jneniorv in 
*d form t 



transformed Eom 
a butter memoryT a set 



_ *n < . 

oimpie ^uent ^gggmet.gAc^ PjLQg^A Y 1 ^ 

by""cbntrolTi1ig the "window" parameters of . i n i tl a i m %pTn t?_ ^o or dilate ^ and ~ s I op 



window configuration tias 



)arameteps . Alternatpel 
:ontroll J 



i memory. a retresJ 
discussed tor 
rameters of lmtl 



Messing. Tne second memory m:r - 

tresh memory, or other memQrv . The 
implementing geometric proces sing 




end-point 



otnef geometric parameters: 
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The geometrip processor configuration disqussed above has .been discussed 
in the configuration of address counters counting along scanlines having the 




JILT 



incremental proc^ssing^^ and'other 
processing elements : 

Tne geometric processing configuration discussed above has been 
iiscussed in the configuration of a Stored , program processor implementing 



r processing 



as 



ring 



Lei 
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being interlaced or by deleting the second field processing and generating 



r interlaced or by deleting the 

tne - tirsF Held at 1 halt tne line spacing 

configuration . Also, other scan arrangements can 
raster scan.- such as the Palmer scan. PPI scan. A-s 



e interlaced scan 



e used Tn place of 

— - ill: — ' 



scan. B-scan. calligraphic 



vector g eneration, and others. , , „ , 

The geome t r i c pr pee s sing configuration discussed above has been 
discussed in the cpnf iguration of a synch pulse, controlled processor. 
Alternately, geometric process ing can be Implenfented to be self -controlled . 
such as b y generating aeomiEnc processing cbntroJ. signals tor synchronizing 
*he display monitor" to IH e geometric processor ■• can be implemented to be 
" ronous . such as by asyncnrpnously storing output , intc~— — 



asyncnronous . su c h as by" a synchronous Xy storing output mforma^ion in an 
?iAiIiary memory affl Ch en J synchronously oufctfuttirfg the stored output 
information To a a " splay:" and can fee r implSmfenEert T.O operate In QtSer 



intonation to a display ; and"" 
synchrono us ana asynchronous torms 
Tne geometric .processing^ < 



*jrMv*^M V «« e g^ t «w^^w^^^^^ i -~-~ onf discussed above has been 

discussed fn the configuration Of. a multiple loop geometric processor having 
an outer field loop, middle sc.anline loor ~ J 1 »n-v. na) - a i„ 

geometric processing can be lmplementeo 
Biien as w itfi ml outer frame loot* instead ot the out 
outer tieic i or trame loop and navinc 



such as witn an outer rrame loop insceaa 01 une ouuer u eiu iquu, 

gn Mer iTelTj or Trame Topp aficTKaving S ^.gFjS / 1 ™ 
Ky scanli ne Basis? or wit h " o ther cohtigurationsi . "TOjrnateiy qgomecr xq 
processing can Be " implemented tor generating images on a Pixel -bv-Plxel basis 

without any loops. 77 _ . ■ ^ , \_ „• _ u 

The qeometr: 



the other' 



[Sometfic processor configurations discussed, herein can be used with 
elements fiiscussed hereirf such as the spatial filter. However, tne 
processor can Pe used ' . 



_ Sr g < 

geometric proces 
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separate from other devices discussed herein. For example .the g eometric 
processor can be used without spatial processing or with different tVPes_Qt 

spatial processing than discussed herein . V ~~ 7 . . 

1 Tne geometric processor contlgura tions discussed he rem have — been 

discussed in conjunctfign with othe r fMtures"ot the present invention; such 
as memory features. Sujrer features . and application teatures . However , _the_ 
geometric processor or the present inv ention provicies important advantages 
fiat can be T used in conjunction w itn conventional "devices; such as 
conventional memories, conventional butters, and conventional applications. 
The geometric processor configurations discussed herein have been 

discussed "tor an image processing system. However, many of the geometric 

processor teaching s can be utilized fc5r other than image Processing" systems . 
such as g raphic display systems. 
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GRAPHICS PROCESSOR 



A graphics processo r architecture can be implemented with a address 
generator and" control " logic generating graphics vectors tor storing into 
image mem ory, image memory- can -tnen be scanned out, such as in a raster scan 
torrh" to r efresh a display . In one configuration , graphics vectors cante 
written into image memory 6n an offline basis and can be used to retresn tne 
display on an online pasisT Alternately, graphics vectors can be written into 
image memory on an online basis time shared with retreshing ot the display on 



me basis. ^ _ , . _ _ _ . , 

ne arrangement of the graphics system of the present invention is shown 
in Fig IP . Supervisory processor 115A loads graphics commands into address 
generators 115B. Address generators 115B generate addresses of . graphics 
vectors for loading into image memory 115CT and for raster . scanning image 
memory 115C. The raster scan addresses scan-out the image in image memory 
115C through the CRT interface 115D to refresh CRT 115E. 

An experimental system has been constructed to demonstrate operation of 
the graphics display capability. The arrangement shown in Fig 1 has been 
implemented in hardware x or refreshing the display in real time. A program, 
such as the BASIC PROGRAM LISTING GRAPH . ASC! ra n be \ised to control that 

experimental ha rdware jfor refreshing the display. In this experimental 

system, the graphics vectors are loaded in an offline manner with the LD.ASC 
Basic program sit forth in the BASIC PROGRAM. LISTING LD..ASC herein; emulating 
hardware loading of graphj.es vectors in. an .online manner. In this 
experimental system, graphics operation is initiated each frame with 
supervisory processor 115A and 
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hardware refresh is performed with address generators 115B and image memory 

' In a hardware, configuration, graphics vector generation can be performed 

m real time using the. software^ emulated vector generation capability 

im plemented in ha rdware tortii. in one nardware conticiuration, graphic vectorT 
cah lie "generated contemporaneously with refresh. such ag with" Qng— i 



call be generated contemporaneously with refresh. such SS with" one 

address " generators (i.e tne XK-address generator and the YR 
generator" shown in Figs 6Q and bK) generating graphics vectors in 
memory w hile a second set ot address generaCorS (i.e.. the XP 
generator and the YP- address generator shown in Figs feO and 



e set of 
-address 



tto , image. 

'-address 
bP) are 



eneratpr and the YP- address generator shown m Figs , frD and &JL! are 

eneratmg the raster sc an addresses t or scann mg-out image memory tor 
i splay, 'in this configuration. image m emory ca n be impremented as a 
ual -ported image memory for simultaneously loading vectors into image memory 



dual -ported image 

and Sca nning- out image memor; 

graphic vectors can be genera 




the rast er scan is blanked: time sharing^ the 



blanked: time sharing thf 
imcs generation , ln'thi; 
He address generators rat 
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LISTING LD.ASC herein has been ufed to load graphic vectors into image 

memory. This is achieved by using the address " "~ 

addresses of a vec tor and by strobing the color : 




9 Period of time exist when the address generators are in a stand-by 
condition. For example, ma configuration where the address generators are 
scanning-out image memory to ret resh a display r the address generatQr s_may 
not .be 3 used during the vertical blanking period and the ret o re maviag 
available For graphic generation 7"Ai so. in a-con^rg^rafcion where the aqfl£ej|£ 
generators are not used during the horizontal blanking period, the address 
generators and FhereFore may be av ailable "For 7 graphic generation during the 
horizontal blanking peripcr . For example, a vertical blanking period , pt 
1 -mil lisecond wi IT permit the address generators to draw about 5 ,000 -graphic 
vector pixels operating at a 5-MHz pixel rate. Consequently, a meaningful 
number of graphic vector pixels can be generated dufmg standby periods" 
permitting fime" s harina"ot r tne address generators tor both, scanning-out an 
image'to refresh a display and graphic vector generation _ " , 777 
r ^ ^ r _- r -- - --implemented to store parameters associated with 

to be generate d, vector memory can be loaded 



the vectors to pe - gener ated .- vector memory can be loaded from various 
sources: such as From^the supervisory processor that initializes the address 
generator ^, trom £ host ^^ pro£essgr7 6r^rrom other sources, 'me vector memory 
can conta in trie start point coordinates and the vector deltas tor the address 



he start point coordinates an 

generato rs and a quantity parameter or distance- to-go 
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for the 



— -r — — — — — — — - ~ ~ - 

^ _ _ _ fter various ^ ^ . , 

synchronization periods; the address gene rators can be reinitialized; thereb 
overcoming the need to buff erscanout parameters :. however . it tne addres 
generators will not be reinitizalized following vector, generation, it may b 



necessary to buffer the scanout address parameters in a buffer memory tor 
reloading tne pixel addr ess generators alter vector generation" 

In the LD.ASC program, the number .or steps tor a vector are counted 



ed 

ardwired 



under program control in the supervisory processor. In a hardwir 
implementation, the number of, steps for a vector can be counted, with 

hardware counter circuit . For example . the quantity or DTU parameter trom the 
vector memory"can Be" loaded info a 74Lfflfe9 counter as a parallel load 
parameter and;' the counter can ue decremented in the count -down "mode tor each 
pixel step during vector generation, generation ,pt the .vector, .can fifi 
terminated by de tecting the 'underflow signal trom the counter at the zero 



coun 



Loading of the address generators from the vector memory can be 
performed m a manner similar to loading the address generators from the 
supervisory processor, as shown in the let.asc program listing herein and as 
discussed relative to T the superv isory processor interlace herein, setting o" 



the vector 
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command signal PDA h hy the supervisory processor in the LD.ASC: program 
. Window generation 1 ranee implemented with parameters for a plurality of 
images stored in a window butter memory aiid selected as the addiress 
generators scan across window Boundaries during scanout and rerresn of the 
CR.-1- monitor. When the address generators c^osg window noundanes The 
previous display parameters can pe puttered in the nutter memory and the 
dispj ay parameter?; associated with the new image can tie loaded' trom tne 
window/ 1 tftitrer memory into the address generators . Loading ot display 
parameters associated -with the new image trpm the window butte" ~ — -- 



op era tioal 
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SPATIAL FILTERING 
161 



Description of Figs. 5Ato 5C 




mgemenc 

Fig 5A shows an arrangement of a 
generates pixel addr.esses to access a 

Kernel 520H, from image memory 520Br ffAxeJ. mtprmatlPtt C 




JgigKt.tabi? 520C 



_ J8 

are each* applied to a corresponding. mult ipl'ier .5.20® and the weicrhjts. W.O to W8 
are each applied tQ a corresponding multiplier 520E for multiplying, the 
corresponding intensity and weight together tQ generate product signals 320 J. 
Product signals 520i ar§ summed toge.ther. with summer 520F to generated a 
weighted aria mixed pixel intensity, vmich is converted to analog signal form 
with DAC 520G to excit.e a CRT display. ... _ 

The arrangement discussed with reference to Fig 5A is representative of 
a single color channel, such a single channel of a multiple colpr pixel; 
i.e., a red, g^een, or blue channel; and such as a monochromatic single 
channel . Intensity information 
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INT and weight information WT ca 




INT and weight information WT can be mp 
the pix^ i intgrig^t^es^whxch in turn, can. 
genera t ixjg weight ea and suimed , g xgnax 5 X r 
discus sea wittl reterence to Fig 5B 



Blue signals 5 ZIP . ' 

The sutq-qf-t he-products processing discussed above can be implemented 
wi^h commercial . such as multiplier 

chips and . adder chips T For example, multiplier chips are manufactured by tRW 
and adder chips are manufactured by Texas Instruments. 
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Description of Fig 7D and the FTR.ASC Lifting 




•diagram form m Fig 7D. This pr.ogram provides f;or accessing of pixels frpm 
the database, filtering the pixels, and storing the .filtered Dixels m 
another fq.le m th$ database. The unfiltered file is deemed a? UNFiyTER.ASC 
and the filtered filed is defined .as FILTERED. AS.C. In tfiis configuration, the 
database is constructed as . 8-stnp$s, each. stripe having 64 -lines and each 
line having 512-pixels. Thn,s comprises an image 512-lmes by 512-p^xels per 
line. The image database is constructed as a packed byte per jSixel with 
128-pixels stored m a septor on the .disk. The Basic program FTR.ASC accesses 
the binary file as a Basic random file and unpacks the pixels for. filtering 
under the Basic program. For convenience of implementation, 2 -pixels at a 
time ape unpacked for filtering and 2 -pixels at a time are packed after 
filtering. * 

The filtering program will nc?w be discussed with reference to the flow 
diagram in Fig 7D. The program is . lipplemented with a plurality of loops. The 
outer loop KRLPI defines the vertical coordinate, or the pixel .kernel . The 
next inner loop KPLPl defines the horizontal coordinate of che pixel kernel . 
The next inner loop OUTLP1 defines the vertical coordinate of the pixel line 
in the kernel. The innermost loop INLP1 defines the horizontal coordinate of 
the pixel pair on the pixel line in the kernel. The program .processes 
3 -pixels per line in the kernel with 2- iterations through the inner loop 
INLP1, then processes 3- 
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lines in the kernel with 3 -iterations .through the next outer loop OUTLP1. 
then processes 512 -kernels per line with .512- iterations through t;he n$xt 
outer loop KPLPl, and then processes 64 -lines of kernels per stripe with 
64-iterations through the. outer l.oop KRLPI. . ... 

The flow diagram (Fig. 7D) is drawn with elements having, .descriptive 
label? that correspond wi.th the program operations. The "line numbers 
associated with these operatiqns are listed above the elements for convenient 
cross-referencing tp the Basic .program FTR.ASC, Reference numerals 760A to 
760AB are shown with connecting lines to the elements for convenient 
cross-referencing in the description. 

Execution commences by generating initial conditions in element 7$0A. 
Operation .th,en proceeds to tne outer "loop KRLPI 760B to address the first 
kernel position at the top edge of the kernel array and then proceeds to the 
next inner loop KPLPl 760C to address the first kernel position at the left 



edge of the kernel line. Operation then pr.oc.eeds to element 760D to 
initialize the KPLPJ loop by generating the initial conditions XB YB XE, 
YE. and BDC . Operation then proceeds to the next , inner loop > OUTLPl 7 6QE to 
address the top line of pixels in the kernel. Operation then proceeds to 
element 760F t<5 access a database record corresponding to the too line pf 
pixels in the kernel. Operation then proceeds to tfie inner loop INLF1 760G to 
Address the pair of pixels at the leftmost side of the kernel in the selected 
1 ins 

"Operation then proceeds to element 760H to access and unpack 
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5 tO 

>rocessijig' of 1 " either, the, first pixel pair or the second pixel .pair. K tne 
ol-flag is? 0-set, indicative of processing of the first pi^Tel pai^r; operation 
proceeds along the 0-path to element. 760AA to yeight the first pair of pixels 
and to sum the weighted pixels in a partial s.unpation. dperation then 
proceeds to element . 760AB .to 1-set the Sl-flag, indicative ot the need to 
brocess the second pixel pair on the next iteration. In element . 760Y, if the 
Sl-flag is I-set, indicative of processing the. second pixel pair ; operation 

proceeds along the 1-path to elem&nt.760Z to weight the second pair of pixels 




Operation then proceeds to element 760J to define the next pixel pair on 
the selected line of pixels and then to element 760K to determine if the last 
pixel pair per pixel line m the kernel has been processed. If the last pixel 
pair of the kernel Jias not been processed, operation branches $long the 
Y-path looping back m the INLP1 loop to .access .the next pixel pair on the 
selected fine of pixels. If the next pixel pair of the kernel has been 
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kernel has not been processed, operation branches alpng th$ Y-path looping 
back in the OUTLPl loop to access the next line of pixels. m the kernel and 
to iterate through the INLPI loop to access the .kernel pixels on that line 
and to filter these kernel pixels. If the last pixel line. of the kernel has 
been processed, operation branches along the N-path to exit the OUTLPl loop 
and then to element 7601$ to test the S2-flag. ^ . 

TY\e S2-f],ag identifies whether: the £ lltered pixel is the. first pr second 
pixel in a pixel pair. If .the pixel is the first Pixel m a pixel pair 
identified by the S2-flag being 0-set, pper^tion brancKep along the 0 7 path,to 
element 760P to I-set tTie S2-flag indicative of the first pixel pair being 
processed and th.en to element 76PCT to .scale the filtered pix;el and ,to buffer 
the filtered pixel. If the . pixel is the second pixel in a pixel pair- 
identified by the S2-flag being 1-set, operation branches along, the 1-path 
from element 760N to element T60R to scale .a gecond filtered pixel ana to 
element 760S to store .the filtered, pixel, pair in the database and to 0-set 
the S2-flag as indicative of the first pixel of the next pixel pair pending 
processing. 

Operatipn then proceeds to element 760U to determine if. the last kernel 
per kernel line h^s been processed. If the last kernel per line has not been 
processed, operation branches along the Y-path looping back in the KPLPI loop 
zq process tne next kernel along tne line of kernels. If the last kernel per 
line has been processed, operation branches along the N-path to element 7^0V 
to determine i? the last line of kernels has been processed. If the last line 
of kernels has not been processed, 

167 

operation branches along the Y-path looping back in the KRLP1 loop to process 
tne next line of kernels. If the last line of kernels i\as been .processed, 
operatiqn branches along the N-path to element 760W to exit the filtering of 
tne stripe. 
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Filtering of Images r, . ...... ^ . 

image ^processing can be j>er£oqned , on digitized, images, stored m the 
database. A stored image can tfe~ loVdecT trom tne "database into image memory 
tor linage processing online with a hardware- implemented image processor . A 
stored im age can Ipe j)reprocessed". such as ottline in the database and such as 
online wicfi a preproce ^ be u performed 7 during 

database g^ filtering da^ the 

images i n ifne i database . inline preprocessing can be performed during system 
operation, sucn as Bv accessing database' images and preprocessing tne 



database generation, suctTas filtering database images^ before storing the 
images in tne i database . inline preprocessing can be pertormed during system 
operation, sucn as " By a ccessing database' images and preprocessing tne 
afcces^ed database images wiEfr coihpression anq liiterina - prior rg loading 
into image memor y, offli ne preprocessing can be pertormed lor tiltermg of 



ttEHifie tilTering other pf&rocess 

therewith is shown in T:he BASIC PROGRAM LISTING FLt.^sC provided herein. 

For this example, the linage is coiistruQte4 in database memory as 
512-lines and 512-pixels per line. Ea<?h pixel is implemented .with a.n 8-bit 
byte havinq the least significant 3 -bits, representing green intensity, the 
next tpore significant 2-bj.ts representing red intensity, the . next more 
significant 2 -bits representing blue intensity, and the most significant bit 
being 
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presently unused. The image is divided into 8-subimaaes /. where each pubimage 
contains 64-lmes m a stripe. The stripes, are identified as stripe-0 Co 
stripe-7. For example, the lake image has the topmost stripe storeff as the 
LAKE5 0.BIN file, die next lower stripe stored as. the LAKE51.BIN file, the 
other stripes stored in the ascending XAKE5n.BIN files and the lowest ptripe 
stored in the LAKES 7 . BIN file. The filter prQgram accesses each stripe in 
sequence, filters the stripe, buffers the Stripe as the FILTERED .BIN Tile, 
and stores the stripe as the FLAKE5n.BIN file. The. filtering operation 
accesses a kernel of pixels surrounding the center pixel ai)d consequently 
overlaps stripes for the fir?t line and die last line m a stripe. Therefore, 
filtering, of each gtnpe is implemented by. accessing the particular stripe as 
the PRESENT . BIN file, accessing .the previous state as the PRIOR. BIN file, 
and accessing the subsequent st.ripe .as the NEXT. BIN f?-le. ^ 

%n thj.s example, filtering is implemented . with a .9 -pixel kernel 
organized m a 3 -pixel by 3 -pixel array, This filtering; is performed by 
multiplying each df 9-kerhel pixels by .the cprjresponding one of 9 -kernel 
weights, summing the weighted pix^l intensities., and r then scaling to 
normalize the filtered intensity. This processing is performed .for each of 
the 3 -color components .of the kernel pixels. Weights cfan be assigned to the 
particular kernel positions, selectable u nder operator control with the menu. 
Kernel weights No. 1 and kernel weights no. 2 "are shaded, where the weights 
are decreasing from the kernel center towards the kernel periphery. Kernel 
weights No. 3 are unshaded. Additional kerne l weights can be defined by the 

operator under menu contr 
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Spatial Filtering With Qeometric Processing 




» implemented with tne arrangement shown m Fig 1A having spatial f lit 
■ v j>duies and data paths tor leecT forward "and teed Pack spatial tTIfii 
Spatial filtering is discussed herein with reference to the basic. Pi 
LISTING FTR.ASC provided herewith and discyssed with reference to Fig 7D. 

S patial filtering can be implemented with a multiple pixel kernel, such 
as a T^pixel hy 3 -pixel . kernel tor impl ement ajig weighting" ot intensities of 



_^ /igs 5 A to bu arid 7p herein . 

represents a smo.oth pixej. intensity. Other 1 — n 

also be us e d . Filtered image ~ — ' 

Be used tor pattern recognii 




be used for pattern recognition, can be used tor image enhancement , and can 
be further processed in feed-forward and teed-hacK configurations \ 

" S patial til tiering can be implemented as pre- filtering, post- filtering, 
and coWinations of pre- filtering and post-filtering . Pre-E uterma may 5e 
considered to Qe tillering tha t "is performed before qeometric processing. 
P ost-filtering may r he ^ considered to te filtering pertormed at ter geometric 

pr ocess i Q g. Fo'y example , pre? filtering , can t>e performed to reduce tne spatial 
tre<^encies prior to geometric processing in order to reduce aliasing. Post- 
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filtering can b e performed after geometric processing to reduce aliasing and 
to provide gmoptfiing . . " , ~T ■ 

Se parate fi lters, a pre-processing filter and a post-processing filter . 

can be implemented for Concurrent; pre- filtering and post- filtering 

Alternately; a single filter can be " shared between pre"- filtering and 
post-filtering operations . For example, a post-filter can~be implemented to 
I: ll ter the "gecTmetfri^ information 7 for outputting to" the display 



e geometrically processed information , for outputting to the display 
Alternately, the pgst-tilter can be implemented to" filter an image 

either been geometrically processed, ."such as to output, to a CRT 



that has either been geometrically prQcessecT, , such as to output" to a Ok 
monitor, ' or has not as yet bee& u geometrically processed "such as -Ha 
recirculation to an image memory source imag 
memory that originally' contained .the until tered , image tor storing jla 



ox: 



as 

■ Itermg 




For example, progressive compression . and progressive low pass filtering can 
be perro-rmed g wffrn tne same weights lfor u each iteration, sucn as to 




>een comp 



on-line progressive ti. 

and displ; 



_— . Jr ---— . ----- , , ering .can pe, implemented by 

progfesgiveiy : ill:eYinq"tne lmafere^ and displaying the t iltered image , .su ch as 
¥or J each iteraEionV while tns Tiltp yea lm^ge Ys also recirculatea DacK to tne 



image memory tor subsequent iterations . 
~ _ On-,Line progressive filtering will 




ssive filtering will now be. discussed. Many applications 
change continuou sly, where it is desirable to display the 
such as continuous m otion ot tne image. For sucn 



me progressive 
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filtering may be particularly efficient. The image can be filtered, in a 
pre-tjltgring or post -til teririg manner, can be geometrically processed, and 
can pe displaye d" and recirculated tor subsequent progress-rive Entering 
l^eraliio ns . ^Thii permits simu^lfaneous operation ot Dotn. tne progressive 
tiIEer~Ing the displaying ot the image aff it is progressively tiltered. 

Oft- line progressive filtering; will .now ,De discussed. fin ott- j.ine 
filterin 



•mis permits simu 

the displaying ot, ,U 
progressive til 
iflgement can be 



— ^3-p^__ j- r—i » ^ ^a^jiiiiafcaJ^ S 1 f 1* t 1 G Jt" - — 

nowDeaJscusseo, An ott-lme 
sed In conjunctipn w£th an gn-lme filter 
~ j - rogressive 




Various 

pre-processing 'an^ 

operati ons, such as low; pass ti 
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of spat ial processing can be provided , such , as 




post-procgs 

. „ Jqw r?r 

spatial treqyiencies in tile 



frequency ^n accordant 



image 



Post-processing can per 



with tne well Jcnown 
rm various operations sucl 
a~tions^P3 



criterion. 



staircasing ana pixel resolution "cdnsTd^ 

uial f r% qu e n c X e s 1? q t nat alia si tig e t t e c,t s , a ye , np.tr in c y Qflu eg cT in to the 



overcoming 



spatial frequencies so that aliasing effects^ aye ,npr intrQaucea into tne 
mge wti . en tfie l ^ ge . in ATOg^jnemQry ,i s samp^efl with tne, image process?*- tgx 

output tina to trie display . W saitelina f ^quency can be determined t>v tne 
scale taccor ot a r dTisjl^ processor, sucn as" tor expansion and compression? 
For expansion , tne spa trial trequenpies are lovjer and nence aliasing is 
reduced. For pomprepsion, the spat.ial frequencies are greater and hence 
aliasing considerations, are. more important. . Therefore, as the image ir 
expanded^ the anti-aliasing filter related spatial frequency may fte inyreasec 



expanded^ the anti-aliasing filter related s patial f requency may Jpe increased 
to^provide greater deEail And" as tne image T^is gompre^sed. tne anti-aliasing 
filter related spatial treguency pay ge reduced ^o greduce tne detail 



r or optimum 
ma^ be cent it 



et^ii 



aliasing filter 
As the image is 



compressed, tne related frequency or ens anr.i -aliasing r. liter can be reduced 
as a function of compression, continu ally redl ining tne amount ot detail in 
tne imag eT As tne ~ image ir expa nded:- tn e related treguency ot tne 
anti-aliasing filter can tie increased to increase tne amount "ot detain 
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The amount of detail in a previously anti-alias filtered .image may not 
be increased by re-f llteri.ng with a higher effective spatial frequency 
anti-aliasing filter. This is because the detail has already been filtered 



the lower effective spatial frequency g>f the 




nc .processing. xniBp 
r iplV line 15ur f e r gene 
nei in accordance with 



kernel and processing the 9 -pixel kernel in accordance; 
using sum-of -the-product n processing logic. This t 

capabilities, as previously discussed; such as increasing 

resolution with pr ocessing gam enhancement, increasing spatiaiZresa 
subDixel resolution , smootnmg ot staircasmg etlectr 



ost-processmg is 
erating a 9 -pixel 
1 a get of weights 

f>rov;i_des . various 
gaging Intensity 



suEpixel^ o t staircasina ettects. smoothing ot motion^. 

flncTP fineg ^fr^^j^ n p r g-giltergd for g part i cu l ar l e v ? 1 _ of exoangion 
or compression, it may n ot nee " 



^ M „ . -0 fae'pre- filtered again until the geometric 

processor needs to Change tiie level ot expansion~or compression : In one 
configuration previously discussed, an image is pre - compr e s sed and 
pre-filtered for that 
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level of compression and stored in various pre -compressed and ^ pre-filtered 



stages m database memory.. In sjach an arrangement 



pre 

\he ap pro priate stage of 




^r 



ipemory. This image can be accessed from the" input Sutter ror loading into 
image memory tor 'geometric processing . AS long as expansion and , compression 
processing is witmn jbhe ran&e or image 



Loading t he image memory 



memory 



r\a^ry w lrn V. n e previou sly a is cur Red virtual scroll iricr and 
ww>w )ilit~y t 

,. t .en the geometric processor condition exceeds either the range of 
expansion or compression associated with the pre- compressed and pre-filtered 
imSge stored in the buffer memory or exceeds, the t reins X at ional capabilities 
of the image stored in the buffer memory, additional image information can be 
accessed fronjt the database m^ory to Accommodate these geometric procgssgf 



image memory 
wrap - ground -gapa. 



s . For example, if 
TwEfier memory are exceeded 



I 



condition 
im age 



e range 



ex pansio n and "compression 



it ion i 



est 



memory- having the new 



ex pans 

accommodate- tne new range. 
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Similarly, if the transl ation of the image exceeds the image stored in the 
- ' additional image lntormat i on can be accessed from image memory 

fer i memory to exhend the translation capaBilityoT 



Buffer memory 
" — lis 



tor over laying in the Puffer ^memory to exl 
the geometric processor m that direction 

- - ->ve , operation can 
--He a; 



In view of the above, 
iortipn o f an image having 



proceed as follows. Initially, a 

iate scale range and the appropriate 




processor wilT. translate through the image in image memory, outpucting the 
image for post -processing and" display ., As the translation approaches - 
boundary of the image memory, additional image information can pe '.Toaded fi 



a. 

rom 



boundary of the image memory additional image information can be loaded fro 
the buffer memory and" overlayed into image memory behind the translatin 
window . As the information being accessed from the butter memory approaches 

"Iddit -—- , 



boundary of the butter memory, additional image ^information can^be^accessed 
from the database and overlayed into t he butte~ r memory behind the direction 
of translation of image memory. 



AS the geometric 

s sor_wi i r_ compress 
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rocessor js commanded tQ expand, 

he window in image mem ogy^ QUtPU££ 



ric processor ?,s i 

ress fche window in 3 
indqw) tor post-proc 
window) expands." pi 
be provided byTa 
ge nfemory .- such" asf 



the geometric 
-.he expanded 



proce 



i 



ng. 



s" the expanding 



image (compressed window) for post-processing am 



e resoiuhion 01 
oadmg expander 



the image "decreases 
higher detail image 
y or ia-^^ -"-^ 



mage ( compress iog 



expansion can 



info r mati on into image nremory? 
as tne geometric proce! 



rom 



is tne geometric processor .is.comman , 

processor will expand tfe window in image memory; 

, -----Kir 1 



image ( eraan^cT w:^ display . £ ne expanding 

window approacnes a pounaary 01 tne image memory : additional- image 
information can t>e loade d from tne butter memory and 'overlayed into image 



memory to maintain the expanding window within image memory. As the ' expfflfong 
Window approaches ' to wi t hin a porti on , oE i ma ge me mory size , the ^maqe in 
image memory can he p re- r-omp'regsedand the window can pe reduced in size 
consistent: therewith ^ho ma±$ £a"n ^e window wjf.hin a sale size within the 
Koiino'aries 6t image memory . Tre- compression can he provided pv compressing 




the Putter memor y , additional image information can pe accessed srom t 
flai!afiase and oveAayefl 1^ With the Window 
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posir 4^n r in n image f jnemor^ b is U Ddane ^ h appropri ate 



yvtf " w TK^rejoreT 3W tAe"ynfege memory is updated with the more appropriate 
portions o f >.h"e image from tne : butter memdrv ana the Wje^PgggJY \3 Jjpaaf eg 
frir.h'fcne more important portions or tne image trom the ; gataoase ; wnere — tna 
database scores "CKe Fuli y image, " the butrer r memory st ores a . gupset M this 
full image: and the image memory stores a smaller supset Ot this imaga^ 
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MEMORY ARCHITECTURE 

181 



General ,. „ ^ . ^ , , . . 

The memory architecture .of the present invention has important 

advantages in implementing . digital systems . It is applicable to special 

purpose systems: such as p^ spray systems, array prgreBgors. ang P*Pe£3.nT 

t" general purpose systems; such as general 



systems-, 

Systems . A configuration i s aiscusseq nerein wnere system speea can 
implemented Eo~~pe significantly taster than implied Py memory gpeec 
considerations . This configuration" uses a combination of novel architec.turaJ 
features tor outputt.ing of relatively high bandwidth information with a 
relatively low bandwidth memory. 
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Brief Description . . . ,, 

A memory architecture in accordance with the present invention will now 
be discussed: with reference to Figs IP and 2M. Alternate, conf igurations pan 
he provided to implement the system of the present invention. However, this 
configuration is exemplary of the system ot the present .invention. Input 
device 115A generates input information under control of input clock 115G. 
Address generator 115B generates addresses for. memory 1^5C under . control of 
input clock 115G, such as .for storing information from input device 115A in 
memory 115C or for accessing information .from memory 115C under. control of 
input device 115A. Memory I15C outputs information accessed with address 
generator H5B under control of input clock .115G. Buffer 115D receives 
information accessed from memory 115C for buffering therein under control of 
input clock 115G and generates information buffered therein under control of 
output clock 115F.. Output device 115E, such as a display monitor, receives 
buffered information from buffer 115D under control of output clock ll$F. 
This p ermits information to be accessed from memory 115C asynchronous with 
informati on T to Tpe outpuE to outpul: device ligb. Hence. Putter' 115D can input 
--- ^er controT of input" clock 115G and can output information 



informat ion under control of input clock 115G and can output lntormat 
under Control ot Qutput ciqck ilSy tor ^synchronizing ot lffitormation tlow. 
averagin g ot information rate, reorganizing ot information into groups, and 
tor other purposes: V~ 

183 

In an alternate conf igiuration, information from memory 115C can be 
outpyt directly to output" device 115E und er control of input clock 115G7~such 
as with Input clock ijSG"and output clock the 'same clock and being 

connected ~theretoget;jier . 

A mul £ i - dimens lona 1 address configuration is shown ir\ Fig 2M, Address 
generator 115B generates an address worcT having a rp- addressing .portion 215E 
a Y-scanput portion, 215G, and an X- scanout portion 215F. This arrangemen 
has part icular advantages because the X-scanoutT signal 215F and the Y-sCanou_ 
signal 215G can i be > genera ted more rapidly tnan re-addressing signal 215E to 
access or to write into memory 115C." ~~ 

Memory 115C is shown partitioned onto 2-b.oards 2±5B and 215D. RAMS on 
the 2-boairag can be addressed with re-addressing logic 215E. The RAMS are 
shown organized in an X-Y array of rows and columns. The X-scanout signals 



are decoded, into a plurality of row signals shown radiating horizontally 
right from the X- scanout Jihe 115F. The Y-gcarjout signals are decoded into 
a plurality of column signals shown radiatina , vertically up from th 



column signals^ shown radiating, . vertically vm from 
115G. The decoded row and column T.ine signals erfebled J- 



the 
row 
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Various address register cor\f igurations will now be discussed . with 
reference to Figs 4Aand 4B. Fig shows a dual addresp register 

configuration having an X-address r.egister and a Y-address register, This 
arrangement is particularly applicable to display systems haviijg a 
2-dimensional memQry map ana generating vectors for storing into an image 
memory or for reading out of an image memory. The X-address register and tne 
Y- adaress register can l?e separately controlled to generate a 2- dimensional 
vector for accessing a pixel In the memory. Actually the 2-addreqs registers 
can be considered to be co ncatenated to form T a T single address parameter tor 
memory accessing. However, two separate 2 -dimensional address registers , are 
a convenient way of visualizing a single dimensional memory configured into 
a 2- dimensional memQry map. In a, cpn? iguration discussed .for the 
experimental system herein, the 6-n\ost significant bit p of each register are 
combined for an ll-bit ?re -addr.es sing word and a I- bit board select signal 
while the 3 -least significant bits or each register are separately decoded .to 
select one of 8-row§ and one of 8-columns on each bQard m accordance with 
the ^-scanout signal 215F and Y-scanout signal 215G discussed with reference 
to Fig 4A. . . . . _ 

Fig 4B shows a single address register configuration, which can be im- 
plemented by concatanating the X- register and Y- register sfiown m Fig 4A or, 
alternately, may be conceptually defined as a single register, a^ quadruple 
reqister. or other configurations. Selected bit^ of this single address 
reqister may be used to control re -address ma .and rQw and column select , for 
thi memory In accordance with Fig 2M. Many corif igurati ons of signal groupings 
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can be implemented / sue!) as us ing s ignal s XAO ; XA1, XA4 , XA6 , YA3 , YA4 , . and 
YA6 for readdressing; signals XA3 , Xa7, YA5 , and YA8 for X-scanout decoding; 
and signals YAO, YAi, YAZ, XA2 , XA5 , XA8, .and YA7 fepr Y-scanout decoding as 
an alternate to the above configuration discussed, with reference to Fig 4A. 

Memory addressing mqiy be configured in a multi-dimensional form; such as 
2 -dimensional, 3 -dimensional., or 4- dimensional .form. For example . address 



generation may be perf ormed with a plurality of different address generators r 
sucH as'an X~addres s_ generator tor Sne portion oj= a 2 -dimensional address and 
a Y- address generator for tne otner portion or a 2 -dimensional address, as 
discussed tor a 2 ^dimensional memory map configuration herein. Also, 
addresses t ;H, at are , genej ate^ can .be 

narf i f i nn^rl info mil 1 M - mpnsi nna aririrpssPR ? si mil as a 1 - h i t comnuter 




Ip describing „tl}e novel, architecture of the memory of the present 
invention, the word ^dimensions? and wojrds relating thereto have been adapted 
to mean the different; forms pf addressing the RAM£> . For example, the RAMs are 
addressed with a re-addressing portion of the address and a scanout .portion 
of the address, which may be considered, tp be 2 -dimensional addressing, and 
the scanout portion of the address are divided into .row select signals. to the 
G-bar pins and column selept signals to the S-bar pin§ of the RAMS, whiph may 
be considered to be 2- dimensional spanout addressing. A .memory Ijaving an 
address with the combination of a 1-dimepsional re-adares$mg portion and a 
2-dimensional scanout pprtion may be considered to be a 3 -dimensional memory. 
This terminology is different from terminolpgy associated with 2 -spatial 

dimensions of an im^c— ^ ~~ n J — 3 ~ — 3 n ' 4 1-1 

dimensions of an 



arrangem ent dispussed 
±n greater detail herein 

t0 S m^i mQ * utQ *' 




" T The memory gan j?e. configured in a , 2 -dimensional form, .such . ag 

l - dimension " being jTne aata ftlocfi "address, ana jfte ptfter dimension being thi 
pixeA address^ can be partitioned 

int o a p i uraii a least significantTbyte tc> a most signwcani 



int o a p i uyaii tyof bytes Trom a least sj^if icantTpyte to, a most Significant 
By te an d" e a ch py ce can be used to'aWyess 
memory . Image me mory scanout can tie implemented t>y scanning sequential 



addresses at a hi g her rate a nd by re-addressing the memory at a lower rate. 
such as w ihn a gated clock, a gating signal can be 
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cycle even rBiough the inf ormation may be .output . ,- - - , - 

duty cycle, or at a relatively low portion of the time Chat .the memory 
inf formation is available, or by not utilizing the information immediately 

„. ___ - -- J 1 - •= — 3 memory. A buffer 

r as fast as image 
ag constraint frpm output speed considerations. 
_discussed herein can als~o be applied to a 




3 



correla 



he memor y arrangement discusse 



correlat or processor memor 
c^orreTator . The" me~^ 



3aE 



n& eacn byte 



Q£Y. 



Pat a, 



can he 



-dimension Being tne data block addr< 
address within ^a "block 7 ~aI ternately 
urality of byEes trom a j.east jsignit; 



s trom a least significant byte , to a most significant byte 
he " iisea Eo~ address i a different 7 dimension Ot the memory . 
implemented by scanning 7 sequential aggresses at a higher 



ata scanout 

ahe and by re -addressing the memory at a lower rate. suc5 
lock 7 A gating signal can be used to gate the memory acces 



as with a gated 



access 



188 



clock without gating the output clock, permitting correlator operations to 
proceed uncTer c6ntroi of " the Ifgn-gated output clock without being effected bv 
gating oF the memory cloc k. A buffer memory can be used to temporarily store 
correlation information/to reduce sensitivity ot the correlator to gating of 
the memory clpcic . A Butter memory also perfflits accessing ot the correlator 
data at r relatively nian duty cvcie even though the mi "ormation may be 



the memory clock . A" butter ipmory also permits accessing of the correlator 
data at V reiat ively nign duty cycle even though the into rmat ipnmav be 



availa) 



fable f 



-cr- 



ime. 
:ion 



imm ec 



perm; 



:orma 



-ator 



a substanT 



also 



processor 




ion hei- 



ress within a block": 
it bytes trom 



ceased in sequence tor executic 

configured in_V 2. -dimensional torm: such" as 
)ck addre ss and t.fte otner dimension being the 



the address can 

a least significant 5yte~Eo a most sianiticant b 
a Eo"addre J ss a dirterent dimension ot the memo 



36 



ernateiy 

least fiignif 



arti^ion ed'into 



t dimensT 
ltial addl 



)ata scanou^ can 
rate and by re-addres 



LSe. 



implemented py scanning sequential a 

,=1.- at a ipWer rate 



clock. A gating si 
gat lng the outpuT^ 



mg the memo 



can b e "used 
O CK , permitti ng 

-JlT 



resses at a highei 

ry at a" lower rate, such as with a gatec 
. to gate tne memory access clock without 
? op erations to 1 proceed under control 
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of "the hoh-gated~output cfock without 
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being effected by gating of the memory clock. A buffer memory can be used to 
tem porariIy"store fft information" to reduce sensitivity ot the FFT processor 
to gating of the memory clock A butter memory also permits accessing ot the 
F FT da t a at a reiativgiy^ "high duty cycle even though tne information maybe 



rocessed~at~a~ lower duty"cycle7~6r~at a relatively low portion ot the time 
hat the memory information is available, or by not utilizing the information 



immediately arter the information becomes availa 

permits "a ccessing ot 7>;ft~ data supstantiaiiy as fast as tne 



er memory also 
a memory can be 



ccessedT" re^l:"rng r "cohstraihts~rrom output speed considerations . 

Tne memory arrangement discussed narein- can also be applied to general 



pur pose computer memory . Instructions can be accessed in sequence LOT 

executio n" of the computer arithmetic and control logic. The memory can be 
configure d in a 2 -dimensional form, such as l-dimension Being tne instruction 
ita block address and th e otner dimension being tne instruction or data 

Alternately, the address dan be partitioned into a 



<=*^L a. c. j.yiict,i. mill, atfyi "■■^ J. uiuiginxuii "^^"J, _ xwij 

or data block address an d tne otner dimension being the instruction or data 
address w ithin 7a 7T3i"ock: Alternate!^ can be partitioned into a 

plurality ~ot ISytes yrom a least sigfrificar^byte to a mosi: significant byte 



i 



sucla as 



Jd2J 



:er 
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memor 



re due 
memory 




permit 



iing 



comput 



Ltter 
at a 



relatively hiqh duty cycle even though the information may be processed at a 
lower duty cycle, or at a relatively low .portion of the time that . the memory 
information: is available, or by not. utilizing the information immediately 
after the information .becomes, available. A buffer memory also permits 
accessing of computer instructions .and data substantially as fast as the 
memory can be accessed, reducing constraints from output speed 
considerations. . . , . , , ^ 

Memory architectural f.eatures pertaining to high speed scanout in 
conjunction with re-addressing can provide speed enhancement;, such as a 
3-fold improvement in speed. These feature are particularly, pertinent to RAMs 
having multiple tristate control signals; such as, the Mitsubishi Electric 
M58725P.RAMS: RAMs having a single tristate "control signal can al so b e used 
with this configuration, but "may involve additional decoder 1 p^iC to Ogc gfle 
spanout address signals, sucn as with lin ear select arcmtecture consistent 

WTt ' n M^lin^ fP * pr e s ent invention may Ki^ggfj^'V^f 

nontefit o F Y di splay 7 application tor purposes ot illustration . However, -J^s. 
rnsmory ar c hitecture inapplicable to computer mam memories, bu^er memorj,es I 
signal processing memofe ss. and otner" memory applications in addition to 
rn splay "memories .' 
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Re-Addressing And Scanout Memory Architecture . , 

Multipll dimension image memory architecture, as previously discussed, 
involves simultaneous accessing of multiple. pixels, such as in a 
2 -dimensional X/Y array, to increase, effective memory speed. Such a 
configuration is appropriate for a 2-dimensipnal horizontal, and vertical 
scanput for refreshing a display monitor and is also appropriate for other 



scanout for refreshing a display monitor and is a±so appropriate ror ocner 

applications; such as generar purpose computers .and — special purpose 

processors . Such a memory architecture may" need butter registers tor 
temporary storage ot accessed information, sucn as tor temporary storage pt 
accessed ^pixels so jpnat a new memory access cycle may fie initiated while the 
previously "access^ rerresn the display monitor. 

An alternate contiguVatio n is discussed" herein wnere a_DlocK 'ot pixels is 



An ai tern -ate configuration is discussed herein Where a blocK of pixels is 
Rimiyitaneousiy a ccessea anti is scannefl-out witnout tne need tor butter 
registers or over lapping memory accesses This configuration can involve a 
multiple access p erYod.- v?Kere _ storea information^ ig scanned put rrqm an 



multip le access period. - wnere" stored information is scannec 
accessed block at nign rate (snorter period) and a new bl 
lntormatipn is accessed a r a lower rate (lower period) . A Dutte t m»»,^v. ^-^j. 
as a FIFO ' pr "a double Putter memory, can be used to equalize these rate and 
period ditterecesT 

A novel memory architecture wij.1 now be discussed which enhances memory 

speed and .econdmy. This architectu re can be characterized — as h 

mult i - dimens lonal mempry~~architecture that is divided into 2 -address 

portions a high speed address portion and a slow speed address portion. 
Another characteristic is a combination scanout and re -addressing 



ock: ot storec 
ytter memory, sue! 



architecture . Another 
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characterization is use o f tristate memory control logic to reduce the need 
tor butler regist ers and multiplex can be accomplished bv 

taKmg ad v a ntage, at. certain teatures ot rams. fc ~~ ~ ~ ~~ 

conventional RAMs haye a plurality ot input. address lines for addressing 
stored information, tristate output data direction control logic for 
selecting data input for writing and data output for reading, and tristate 
chip select logic for gating output information onto a bus. Use pf these 
circuit features m a novel f ortft implemented in the memory architecture 
described herein provides important advantages. For example," tristate da ta 
input and output control^ logic can pe used in" comunction with tristate chip 
select Togic^ to provide a nigh speed 2-dimensionai scanout tor rapid 



described nerein provides important advantages . For example,' instate da t^ 
input and output control^ logid can be used iff comunction with tristate cni 
select Togicr'to"" p T^viqe "a nigh speed 2 -dimensional scanout tor raoii 
accessing J ot rAms / The" ^-dimens ionar scanout arrangement reduces auxi liar 
deco^ding^and select ion logic :. reduces output-Putter logic . is compatible wit; 
2- dimensi onal "memo^Tnap'ar^ relatively high soee< 



operation witn relatively^. ow speed RAMS. . 

* fli gher speed scanou t can oe used in conjunction with slower speed 
addressi ng of the Rams to provide an average access rate that is 
slgnp icantiy^. higher tnan trie Addressing rate. For example, the Mitsubishi 
Electric M58725F RAMs have a 200-ns address period and a 100 -ns scanput 
period. Assuming that a system will scanout . 4 -parameters before re-addressing 
is necessary and assuming that re -addressing^ is implemented with 3 -scanout 
clock periods, 5 -parameters can be accessed in 7 -clock periods; 4 -parameters 
times i-clock period per parameter plus 1- 
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parameter times 3 -clock periods per parameter; in comparison to conventional 
re -addressing, where ^-parameters can be accessed in .15-clock periods 
(5 -parameters times 3 -clock periods /parameter) . Th,is scanout , and 
re-addressing example yields an av.erage .or 1.4-clock periods per pixel for 
the scanout and re-addressing configuration compared to.3-clocjc periods per 
pixel for the re -addressing configuration, yielding an improvement of about 
2 -times in speed for this example. 

RAMs are conventionally addressed with a number of address lines, such 



as 11-address lines for a 2,048 word RAM. Address signals typically propagate 
through the memory array and .consequently can have relatively long 
propagation delays. RAMs conventionally havfe tristate enable signals to 
bermiC bussing of output signals and to. select data lpput for storing and 
data output for accessing of aata. The tristate enable, signals can be used. to 
gate the RAM outputs ana consequently can have relatively short propagation 
delays . 




access 

more frequent accessing of data with tfre faster scapout control signal s . 
Therefore, the average propagation delay is reduced, being a weighted average 
of several shorter Scanout propagation delays and a single longer address 
propagation .delay. ■. . , ^ . , . . ' ^, 

^ ^ Sp e ed is enhanced by changing the clock period to be a functign of the 
addressing operation, such as a longer clock period for re -addressing and a 
shorter ciock period for scanout. a buffer mfemory; such as a FIFO, double 
buffer, cache, or 
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scratchpad memory; can be used to buffer output infQrmatp.on from the memory 
for providing a constant memory output clock period in. response to the 
variat" 1 " J " J 




G^Pixel^"" and usmcr relatively shorter propagation delay tristate control 
signals to select a pixel from the se.lected Dlqck. Elach address generator- 
generates a concatenated address having a 3 -bit. tristate contrcSl signal 
portion and a 6-bit address signal portion. The 3 -bit tristate control signal 
address can be implemented with the least significant bibs ( LSBSJ o£ ' the 
address word" anci " tRe"6-address bits can be implemented with the most 
gignHicant jjiEs (msbs) "of tEe~address ^wora .~ The padres s generator^ "can be 
I m plemented . to VP dftte the, liflfesfl, wftere the kses canape updated more 
frequently r 1:han r the MSBs and where the addresses can syan through a block, ot 
pixels is the LSBs"are updated and Change ~Ec » a T dif terenfc block of pixels when 
£ne msbs are updated , ffidating of Fhe msbs can detected with an overflow 



ne Maps are upaaceQ . up dating , QE ^Qg M&as can qefcgcteq w^tfl. gtt gyg^t^gw 
rom the Lsbs'Eq the MSBs in the address generator Therefore . the LSBs can 
$ updated relatively rapidly r to scanout" with the taster tristate control 
Ignals through the pixels within a Slgck and the MSBs can Joe updated 
elativeiy slbwly to^ Chan ge" the "selected hlocK . " ~ ~ TT 



relatively siawiy to Change the selected JDlocK. ~~~ ~ ~~, TT 

For purposes of illustration, an experimental configuration with an 
image memory having 262 , 144-pixels arranged in a 55.2-l?y-512 pixel memory map 
was implemented. Also for simplicity, Mitsubishi 58725P RAMS , Texas 
Instruments 7400 series TTL logic, 
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and Intel logic is used. The Mitsubishi .RAMS have 2K- words by 8-bitg per 
word. Therefore, 128 -RAMs are used to provi4e 2 62 , 144 -pixels . For efficiency 
of implementation, the RAJMS are arranged in two, 2 -dimensional boards each 
having a binary quantity (i.e., 8) RAMS for; each dimension. Consequently, the 
128 -RAMs are arranged on 2 -boards each having 64 -RAMs, arranged in an 8 -by- 8 
block of RAMS per ""board. . , „ 

Each RAM has an Jl-bit; address for .accessing one pf 2048-words. Another 
address bit is used m this, configuration for. selecting one of the. two RAM 
boards. For convenience of; discussion, the 11-bit address apd the 1-bit Ipoard 
select signals are organized in a 6-bit X-address dimension and a 6-bit Y- 
address dimension to select one block pf 64-pixels out. of 4096 blocks of 
$4 -pixels. This arrangement is shown .in the memory diagrams and tables 
included herewith. The memory map contains a 64 -by- $4 arjray of blogks for, a 
total of 4096 blocks. The 12-address bits are organized into a 6-bit Y-ax^s 
address and a 6-l?it X-^xis address for a 64-l?y-64 array of blocks. The 6-bit 
X- a^is address is divided into a 5 -bit X-axis address to each RAM and a 6th 
X-axis address bit to select one of . the two 64-RAM boards. Use of the 
X-address bit 3s a board select bit causes the 64-by-64 array of RAMS to have 
alternate X-dimensional colunins to be selected from different boards. 
Alternately, use of the most significant X-address bit for the board select 
OitTouId cause tni 64-ay -54 array o£ rams to "have all of the x-QimensionaT 
RAMS in one board ad] acen t to each' other and all ot the X-dimensional RAMS in 
the othe r ftoarfl adjacent to each other. 
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^ Each qf the 4Q96-biQck;s L Q£ w pixels can ba CQnfiigur.ed in an 8-by-8 array 
of 64^pixels . One of the 8-by-8 arrays of 6ft -pixels Is " shown m the image 

memory ^ diagrams and . tables included* herewith .The 8 -by- 8. array cap L be 

'ddr^ssed with a 2-djmen^iQjQal 3 -bit by. 3 -hit ^dacesji organised ^ a 

ress anri^ a 3 -bit: Y - addr e s s t orma t . Each of the two 3 -bit address 
he decoded , lppo $-adflress lings, yieldina an B-by-8 array ot 
' t one o 




10hS ,can 



I— — T -1 ]~ — - ■ ' ■ — ' "1 " |~ ~ — T — — -~ ■ — ■ ■ — ■ " " 

ines. it one ot the nrst group o 



me of the tirsc group or a -aaaress - Tines is e xcite 
select a row of p ixels and r.ne second 'group ot B-adrtress lines is excitecTTo 
select a column ot pixels , then the one pixel at the intersection ot the row 
address line and column address line is selected out ot tne 64-pixels per 



?Xq c k 



The memory scanout and re-addressing arch itecture can be implemented for 



cutting across image memory lin gs to generate a vector drawn at an angle to 
the r a s her line £ and can Bfe efta ciently uSeg 1^ 

•For example " raster scan output s proceed on a line -by -line fcasis; consisten 
with the line organization of the i^age^ memory. jjL s M. c il Jffl. ^ ar ran^™™ 



single tn-Stj 



such an arrange™ 
r scanout as ifhg 
3 ocic ftound^ries . Ti 
: pixels; in contra 



stent 
ment . a 

TEH 



Ke aBove flfiscripa T-dim^n sionai array or pixels perr 
n a 1 - dimensional memory system is more nearly 
ulti-dimensional memory system. For example, a linear 



ESI 
in 
mult 

can have all 



ocK: . biock traversing 
constant than in a 
block along a scanline 



vector consii 
2 -dimensional 



lonal memory system. For example, a linear block a lpng a scanline 
. pixels i n t h e block acces ffid framY-al^ 

lcferaTTions . This may Be " ai tterent trom a system having _a 
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scanout block with vectors becau s e a r 2 -dimensional scanout . b lock may have 
fliFteren E numbers ot "pixels traversed within a block as , a tunc tl Oh , pt E 5e 
yectoy parameters ■ ><ft y example, "the" nu^er ' Qj^y^jls" pyayfiygeg |iaO £-4 
tiingtion' ot THe p ixel entry pgint to fcne block ancr a tunction ot the scanout 
vector "[anal e through tKe^blogk ? where th e pixel entry PojnE'may pe'a 'ttigctjgn 
ot vector 3 positio n and tbe scanout anal e "may be a function ot vector slope. 

maximum? typ ical, average, and minimum number ot pixels scanned^in 



rne maximum: typical, average, and minimum number or pixels scanned in 
a block: can be aiftVrent' tor^irt'ereift 

raster scan arra ngement.- ail pixels in a Diock mav De scanned tor each 
traverse ot VnV 3 linear bloc*: fnererore. in a J, -dimensional plocE 
contigura tion: fcne maximum. Eypical ■ "average . ..and minimum number ot pixels. 
gcannld_in a block may be Hne jfameT w^^^ 

KlnfrKT In a"a~aime nsi6naT dIocIc cont lauration navincr vector directions . the 
maximum number ot pixels T may be the number ot pixels along the- diagonal ot 
the biocK : "the T minimum number ot pixels may be a single Pixel, such as a scan 
clipping the corner ot a blocJcT arid the typical number and average number mav 



the block :~ the minimum number ot pTxe is may be a single Pi: 
cli pping" the corner ot a blockj and the tyjbical number and 
be J fnbetween Ifhe T maximu m and minimum. sucn as determii 



,moer may 

icai and 



fie ^fnpetween tne maximum and minimum, sucn as determined py" typical ana 
average block geom etry relationships . Consequently, in a lineaf block raster 
scanout configuration, greater average s cariout rates may be obtained due to 
the scanout of more pixels per block: ; . _ _ . . _ . 
A £211 



ut oi more pixels per Block. . 
[Her memonf contiguration can have the form of a multiple buffer. 
a "double but fer" ~ Alternately, the memory contiguration discussed 



such as a doubl e butter. Altefi 
herein having gated clocks and a 



plurality of clock periO' 
average a plurality" ot - 
tor loading at' art m 



198 




-bits per word, as shown 

provide othe~r word sizes 



Memory Enhancement 
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, The 
implement e 
pmmuhicat 



o utp ut of memory, in the .expeirimgntal .configu 

g co . p ropagate gown a gatapipe , to, a butter Z 
:ion witn the front end control logic ana adSre 



„ r .. _ so 

nereifofer'^t, c'aa'fie" consAderfia 



■CK, BK 



ration can,, be 
memory witnout 
s,s generator? , 




i peUne permi t s i ntrogucing clock, skew, where the <?lock~i fo tne outpi 
ifre'can pe ^ sKeweo i angag oe ,tfte cj,qck to the input, at the gata p.ipa 
ermits greater speed in view ot propagation delay considerations 




permits greater speed in view .ot prppagation delay considerations . 

example, m the experimental configuration, the output .registers are clocked 
with the - j — ^ n ~ ~~ 3 - c ~ n n - 

f or^proj 

the ^n^wer' high" s p e ed ~ In f d r^a tioh "from" t'hV'next clock" may b'e~ clocked^ Ihto^the 
datapipe with the 1.5 -clock period clock. 
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Memory Map Display Architecture ^ ... ... 

An architecture of one form of memory map for a display will now be 
discussed. This memory map stores an image as a 2 -dimensional array of 
pixels. In a monochromatic configuration, each pixel contains 1-mtensity 




u ^ , . , , -dimensional 

architectures nave been discussed. Multi-dimensional architectures provide 



enhanced performance and flexibility, such as by accessing multiple pixels 
simultaneously . . , . - 

Multi-dimensional architecture orovi.des important advantages. It 
provides high speed, because of the addressing of 64 -pixels in parallel and 
because the Cristate select signals, hfive shorter propagation delays th^n the 
address signals. It provides flexibility, because T:he tristate select signals 
can traverse the T54-p;Lxel block at, any. veqtor angle and through any 
continuous sequence of pixels. It proyide.s tj.rcuit efficiency; because much of 
the address decode ancf tnstate logic is implemented on the memory chips, 
because a multi-dimensional 
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addressing arrangement is more efficient than a 1-dimensional addressing 
arrangement, and because the tnstate logic reduces the need for output 
registers 

A configuration for simultaneous accessing of an ,8-by-8 2-dimensional 
array of 64-pixels is shown in Figs 6E to 6N. A . pixel address selects 
64-pixels at a time out, of the total, array of pixels, such as,, out. of 
262,144-pixels m a 512-pixel $y 512- pixel astray. A subset of . the 64-pixel 
block is then addressed w%th tnstate enable signals, such as chip select and 
output select signals. Tnstate select signals can be used to scan through a 
64-pixel block, to select a. sequence of pixels therefrom. . 

The experimental configuration has been constructed . having a. 512 -pixel 
by 512-pixel memory map. For convenience of experimentation, static 16K-RAM 
chips are used for memory map implementation. Typical circuits are the 
TMS-40J.6 RAM from Texas Instruments Inc. and the fI58725P^ static RAM from 
Mitsubishi Electric. These circuit? are configured , m the fgrm of a 2K-word 
by 8-bit static RAM having an 11-bit address,, a tnstate chip select, and a 
tristate output enable. Conventionally, the chip select and output enable are 
used to provide output bussing and to .reduce the need for an output . register . 
In the presei^t configuration, the ch,ip select and output enable signals are 
used to provide 2 -additional dimensions of memory addressing. .For example, 
the 11-aqldress lines are used .to select a block of 64- pixels out of 
262, 144-pixels; the chip select signal is used to select a column of 8-pixels 
out of the selected block of 64- 
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pixels; and the output enable . signal is used t.o select a row of 8-pixels out 
5f the selected blofck of 64-pixels. The selection of a column of 8-pixel? and 
a row of 8-pixels with the chip select pignal and the output enable signal 
selects a single pixel c*t the intersection of that polump and row, from the 
selected block of 64,-pixels. Consequently, a 3 -dimensiqnal architecture 
having address selection of a 64-pixel block, .chip selectiQn of an §-pixel 
column m that block, and Qutput enable selection of an 6 -pixel row m that 
block uniquely selects a single pixel out of .262, 144-pixels . , 

Memogy foips have gagt icular cMra.ctejristics that,, cag fre^gdaptefl to 



memory a: 
lines anc 



a/c^iFec^urgs wnl en are T part rc^ularf^ appropriate " : or the Systems 
herein . For example, memory circuits "cfonventionally have address 

_._id .tristate select lines. |The address n J in " ^ "~ 

select a pixel per chip and the tristate selec , 

disconnect unde?ired chip? from the output bus and to reverse 

for read an*} write operations. However, use of the address lines to select a 
block of pixels and use of the tristate select lines to scan, through the 
block of pixels.proyid.es. particular advantages. The access time from the 
address select is significantly greater than the ac.cess .time from. the chip 
select or the output .enable select. Therefore, ^ccesqmg with the chip select 
and output enable signals can proceed at a significantly faster rate than 
accessing with the address select. . . 

—i— t —m be e xcit e d w ^tla. the, most ■asignifxcant^bjits 

tress g enerated with the address generators? 



2X2 

3G 




The address select lines 
(MSBS [of the X- address and 5- a 
The chip select and output ena. 
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appropriate vector angle through the block as the 3-LSBs of the X- address and 
the 3-LSBs^f the .Y T address„ar§ .updated. When the address update progresses 

1 ' - - ------ - - - - dtire&s . sucn as witn — - — — 



into the MSBs of either t he X-addrgss qr 
a new t>lock ot - ---- - -- ■ 



ess, sucn as 



. TTr ,^nnw , or y-addr ess. sucn as witn an overt low 

- - - ---- - -- pixels is accessed and tfte adcir ess generation then proceed 

within this new B lock ot pixels along a l ine at : the appropriate angle" throug 

the blocK L . . * . 

The/time period fo r memory access ing of a. new block of pixels can be 

implemented to "be ^' ~ — ■ 

previously acce~ 
ixels within a 



*nod tor memory access ing ot a : 
)e longer than the time period tc 
;sed block ot pixeJLs" This " can To 
block at a higherjrate a nd Ynen 
s 'can be implemented ny "using a 
block, to detect an nvprt low cone 



.xels car 

or scanning pixels within a 

ded pv scanning £51 

lock' at a 



e provided Dy scanning the 
access^ a new - L - 



pixels witnin a mock at a nianer ratg and then accessing a new block at a 
lower rateT This "can be implemented ny rising a nigner clock rate to scan 
pixels wilhin a block, to detect an nvp rt low condition in the X-address and 



Y-address generato rs from the LSBs to the MSBs as being indicative of the 
need to access a new t^ V ot pixels, and to switch over to a lower clock 
. rate 'tor accessi ng of the new SlocK ot Pixels. 
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The arrangement discussed with reference to Figs 6E to 6N illustrates 




. ~~ r - — r — ^ -jg- the two 

64- chip boards is selected with the remaining bit of the 12 -pit address. 
This is shown with the 5-bits from the X-address and the .6-bits from the 
Y-address being bussed to all 128-chips of both boards .and with 1-bit of the 
X-address being used to select one* of, the 2-boards in the uncomplemented 
state and the other of the 2 -boards m the^ complemented state. The rbw select 
and the column select aire each implemented by decoding 3 -bits with a decoder 

to generate one of 8 -signals to select one of ° — ^ ~ 

respectively. The 11-address lines are bussed 

each RAM chip. The 8-data lines are fussed from — . — 

RAM chip. Each column select line is bussed to all 8-chipp in the related 
column for each of the two blocks. Each row select line is bussed to all 
8-chips m the related row for each of. the 2-boards. Consequently, the 
11-address lines .select 2-boards of.64-chips each, the twelfth address . line 
selects one of 2-boards, and the 6 liscannout" lines select one of 64-pixels 
per board. 
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Image Meipor 




Address generators for use with the memory arrangement shown in Figs 6E 
to 6N are discussed w;Lth reference to Figs 60 to 6.R. The address generators 
ate sequential gffflresses at tKS a^ropria^e vecto^angJe through 



can generate 



image memory . Multiple RANJ chips, in this example all RAM chips , are 
addressed with the more significant Ijits of the same address w.ord for 
simultaneously accessing the , corresponding word m each of the multiple, RAM 
chips. The leflp significant bits of the address wprd are used to sele^g whigh 



, . _S gignifK 

of ^bhe c hips is to be 
enable control is 



memory operations wfien scanning out within a memory block ancT the ehir> 
address cbnEroi is a lowe r speed conErol and hence involves lower speed mem- 
ory operations when ye -Addressing. Therefore, two types ot addressing will be 




on 



"cEr 



memory operations when 



hip 
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described with reference to Figs 6E to 6N, which are re-a£dres?ing with the 
mpre significant address bits and scanout with the less significant address 
bits . 

Re- addressing is performed with fanout buffers U19A for the Y-address 
bits and U19D for the x-address bits. Thes e . b uHejs - generate the drive 

f a nout t o a large number, o£ chips, in this 



current ne.cessa 
at: ' 



configuration,^ 

witn7each bo|^g 



try to fanout to a large number" ot RAM chips . in 

64-r^ chips are groomed each qt.two image memory boari 
haying repiicatecr ¥uftfrs to tacilitate increased speed 



modularit y^ 



f rs to facility-- r _ . - - 
led toTtneTaaqyess inputs -ot" the feAty 
put, the address eg" are maintained constant . Purmg reZ 
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Selection of one of the .2-boards is, provided with the fourth from the 
le^st significant X-address oit XA3 applied to U19B-6 and to the Intel 8216 
chip select logic. XA3-bar is used to select memory board- 1, XA3 is used to 



select memory board-2. Therefore, as the scanout proceeds in the X-direction, 
the same block on alternate boards are selected without re - address ing ; 
^effectively providing a 16-column by 8 T row .aspect ratio n of RAM chips. 
Enabling of U19B with XA3 or XA3-bar to. pin-6 is an optional control; whfere 
selection of one of two memory boards is performed with the Intel 8216 l?us 
interface logic, as described Below. Gating the column addresses U19B-6 with 
the XA3 andxA3- bar signals reduces., memory power consumption 

The x-axis, decoders uigc .and U19E„.&:a. addressed with- the — least 
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when DIEN-bar is Q-set. apd disabling U19E-5 for write^pperations . during the 
run mode when pi EN- -bar is 1 -seF. Theretqre, during the run mode, U1?C , is 
enabled for reading image memqry and U19E, is disabled for preventing writing 
into image memory: Also, during .the load mode, U19.C is disabled to prevent 
reading of image memory and U19E; is enabled for permitting writing into image 
memory. Enabling of U19E enables the write .pulse W-ba.r inpu.t to U19E-4 to, pe 
steered to the appropriate .row of RAM chips for writing into the RAM chip 
that is enabled, with xhe. chip select column signal to pin 18. 

The RAM chip data lines carry the oytput byte from xhe selected RAM chip 
during read operations and carry tl>e input, byte to the selected RAM chip 
during write operatipns . . A shared bi-directipnal bus structure is .used for 
bidirectional t:ommunicat;iQn with the RAM chip? . Intel 8216 bus interface 
circuits are used for bidirectional communication between a reacj bus and a 

write bus and." 1 "' " 1 "~ ' r -*--' 1 A 1 " 1 

Intel 8216 chit 

U18C, ancj U17D , T „ _^ 

be seen m the mempry schematics (Figs 6E to 6N) ; on the system bus side, the 
8 -input unidirectional lines for each pair of Intel 82l6q are cpnnectecj to 
different lilies on the system write bus and the 8.-output unidirectional lines 
for each pair of Intel 82i6s are connected, to different lines on the system 
read bus. On the memory side, the bidirectional input and putput buffers of 
the 8216s are internally connected together to provide 8-bi- 
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directional lines connecting to the B-lines for each RAM chip associated with 
the particular pair of Intel 8216s. The degign connects the data buses for .a 

?air of columns of RAM chips to a single pair pf Intel 8216s. This 
acilitat$s a tradeoff of the number of Intel 8216 chips used and the speed 
of operation. 

^ pair of ^Aiffl - g ^es^yiVB and yigB^aye^ggd tc^Qg tfrg^twg cglurog select 





„ yn . y 'ected board, ana Efie selected com pair ot-S^s P^.that board 7 The 
selected pair ot Intel 8216s connect the selected RAM to the input bus or 
output bus under control of the above described signals. 

The run/load-bar signal applied as the DIEN-bar signal on pin 15 of the 
Intel 8?16s selects the direction of data communication. If the DIEN-bar 
signal is 1-set, indicative of the run mode of operation; the 1-set signal 
applied to pin- 15 of an Intel 8216 commands data output from the RAM cjata b\is 
to the tnemory output data bus for reading of RAM. If the DI?N-bar signal is 
0-set, indicative of the load mode of operation; the 0-set signal applied to 
pin- 15 of an Intel 8216 comjnaiids .data input to the RAM data bus from the 
memory input data bus for writing into RAlVt. 

During read operations, all RAM chips are addressed with the same 
address signals and one of the RAM chipp is selected with a combination of a 
column select signal and a row select signal. The selected RAM chip will have 
its output data lines enabled to be applied to the output data bus through 
the Intel 8216 bus interface chips. The column select signal also selects the 
Intel 
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8216 bus interface chips associated with selected column for applying the 
column-related .RAM bus to. the data bus for reading. 

Dunjig write operations, all HAM chips are adcjressed with the same 
address signals ar>d one of the RAM chips is selected with a combination of a 
Column select sianal and a row-selected write pulse for writing the 
information from tne data lines into the selected RAM .chip. The. column, select 
signal also selects the In.tel 8216. bus interface chips associated with the 
selected column for applying the input data from the data bus to the RAM 



chips for writing. 
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Improved IC Memory Chip 

An improved """^ 

teachings of the 



An improved IC memory chip, can be implemen ted in accordance with the 

i n gs 5f the present sys t em anct cah'pg^^fe /-^gftant acya^a^s over 

conventional memory c hips . This improvea. memory Chip can have multipj g 
Erisfal.e ^contrqT cMpgetgct inputs, si milar to the ^ 



ErisfaV.e ncmfcrgT chfp Inject inputs, similar to the' a -oafflensionaJL arrangement 
of A lne w chx p seTe^ ynd da p . ex^Ie signals . Also, eacg" ™^^rcM.gfS7 ^ 
an output fegisber : t.o"iaich the accessed data, where the output reg i ster- has 



an ouYpufc fegigKer ^ to' ialcR the accessed data, where the output regis tex ^Jias 
an output ErlsEaEe select wi£h^multi-" dimensional select 

flniPlCT." ffift fflfo B f"fo .*y» ntt»tt -le nr ran hj» i i mlement . ed , 

exem plified by the"25 pistate con trol "ot^tne system disclosed herein. ZP, 
4D y and other muiti-dimensi^ can proviae further 

advantages in de coding and scanning- out from image memory. 
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Memory Logical D.esign n ^ i * . ^ n . . . n . . 

The memory implemented for the experimental configuration is implemented 
in a multiple Board arrangement, where each boa?*d contains 64-RAMs organi?ed 
in a loqical 8-RAM column by 8 -RAM row 2 -dimensional array. All RAMs receive 
the same address All 8-RAMs in an 8-RAM ro.w receive the same X-select 
signal, which is different from ttje " X-select signal for all. other rows. Ail 
8-RAMs in an 8-RAM column receive the same Y- select signal, which is 
different frotp the Y-select signal for all other columns .The input data and 
output data signals are bussed together for groups of 16 -RAMs and interfaced 
witn Intel 82lts for connecting to the. system databus. ... 

the 64 -RAM array on $ board. The RAms are organized in a physical 4 -row by 
16-column array comprising row-A to row-D and colupm-I to cblumn-8. Each RAM 
is identified by tne physical row and column designation; where PAM UIA is 
the RAM that odcuoies the row-A and column- 1 position, .RAM U6C is the RAM 

occupy the 




MEMORY TABLE -A lists the connections for piji-1 to pir}-12 of the first 
group of 32 -RAMs. MEMORY TABLE-B lists the connections for pm T l to Din- 12 of 
the second group of 32-RAMs. MEMORY TABLE -C lists the connections for pin-13 
to pm-24 or the first group of 32-RAMs. MEMORY TABLE-D lists the connections 
for pin-13 to pin-24. or the second group of 32-RAMs. 
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The address connections are the same for all RAMS; where pins 1 to .8, 
19, 22, and 23 are .connected to an 11-wire . address bus; where , each bus wire 




vertical scanout signal from U1?B corresponding to the particular . logical 
column. The horizontal scanout pin, pin 20. for all 8-RAMs in a logical . row 
are connected togeth.er and are connected to .the, horizontal sganout signal 
from U19C corresponding to the particular logical row. The horizontal write 
pin, pin 21, for all §-RAMs m a. logical row are connected together and are 
connected to the horizontal write signal from U19E corresponding to the 
particular logical row. . n 

The dataous connections are the same for ^11 RAMs m a double logical 
column or single physical column array; where pins 9 tQ 11 and 13 to 17, are 
connected to an 8 -wire data bus connect inq all 16 -RAMs m the double logical 




paths. Four pairs of Intel 8216s bi-directionally 
system databus. 
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Other Memory Configurations . . ' 

Various configurations of the memory of the present invention have been 
above^o illustrate how the various features Tana" cfevices of the memory ot the 
present invention can be used to implement a system These cont lourations are 
illustrative" of" number" or other' co nfigurations that can be 

im plemented trom the tea chings herein. . ~\ ~ T 7. ~ 

The memory conti^ ratibn or the p resent in vention has been discussec 

r elatiye^ fo ^ memQry map, fior, an image processing,. system, am 

has briefly been discusse d tor other " appl ications - It is herein intended that 




er addre ssing cont igui 

it tor what may be considered 




at fte r frit earated c 1 r cux t RAMS ana 1; 
ROMs and otner m emory tecnnoiogies 



circuit. 
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The memory configuration o.f the present invention has been discussed for 
a RAM component having 2-tristate control signals for controlling the 
tristate input and output of the RAM. Alternately, other numbers of tristate 
control signals can be accomodated; such as 1- tristate control signal. 
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one of the 3-tristate control inputs to the RAM for what may be considered to 
be a jp-scanout control arrangement. ~ ~ ~ ~~ T. T^I 

The memory configuration ot the present invention has .been discussed for 
an arrangement that applies the same re -addressing portion of the address 
word to Sll RAMS. Alternately, the re-addressing porti on of the address word 
can be partitioned to dif ferent RAMS: ""such as with decoaina ot a portion of 
the address Hand selecting^ or RAMs witn tne decoded signals, such as to 



the addr ess and selecting a. 

the chip select pm ot tne . 

Tne multi -dimensional memory addressing arrangement discussed herein has 
been illustrated with reference to RAMs having 2-tristate control pins., Such 



multi -dimensional addressing can be implemented with a memory having a single 
tristate cpntroi pin, as discussed above. "with digital logic to convert tHe 
single tristate control "pin t o sl multi-dimensional scanout addressing 
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Alternately, this 6 -dimensional scanout arrangement can, be adapted for a 
2-dimensional tristate controlled RAM by combining the 6 -dimensional scanout 
signals into groups of 3-signals processed with 3-input NAND-gates to control 
the 2-tristate pins" ! 

The memory cont iguration of the present invention has been discussed for 
an arrangement that pre-buses the data lines of 16- RAMs into a pre-databus 
and then further buses the 16 -RAM pre- bused signals together onto, a system 



databus . Other partitioni ng of bused data signals can be provided For 
example, al^ data signals can i^e Fused Fnaetifer tne system databus 

without the " intervening pre -busing ot tne 1&--RAM data outputs Alt ernatelyT 
other combinations o~t ~RAMs~ than r6-RAPs can nave the data lines pre-buseaT 
such as pre-busm g ot the data lines ot 8-rams together 
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BUFFER MEMORY 
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General 




ties f such as discussed 
ifcter memory permits ' n 
pixel rate," Such as 




ion rate . 

, _ T jcusseql herein has many advantages. For 

example, a memoiry configuration is provided for high resolution pixel rates 
to a display monitor using slow RAMs for image memory. Also, a configuration 
is provided for generating a kernel of 9-pixels.to be available m parallel 
for image processing using an. image memory ttiat is accessed at a lower rate. 
Also, a configuration is provided for buffering of accessed information that 
is to Be uset^a^piuralitf ot thirties as an^aiternate to multiple accesses tor 



in£ormaEion~Enat.°is Eo Be usecTa plurality ot times! . . 

~A first -in firs t-out ( FIFO) memory, can fie used as a buffer memory . This 
permits substantia lly simultaneous loading and unloading of the buffer memory 
\nd perm its time snaring ot - 
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ingle buffer memory between loading and unloading operations . Cont ent ion 
etween loading and unloading operations .can reduce effective s.peed . . For 
xample (j wit^ unloading requirements determined by tfre display monitor pixel 



exampl , . 

rate and with image 



kep t 



effected" 



Ranges 



:hg display 
the oiitpuT 



- , j G^ l ^ , , m- 

xel period: 



the memory speed c&njbe Kept relatively nigfi and Ene butPuE pixf 1 period can 
E constant . ^his can ~pe accomplished Pv resolving contention in tayor 
output accessing ot the FIFO, err ecEively reducing the input rate due 



ftp Kept constant 
It the ~ 



ot the output accessing ot the 
to contention . A multiple fa- 
arrangement 
with redunde 




iant mejnory , 

another buffer is being uploaded, consequently , reducing contention 
therebetween. Therefore, loading and unloading of the buffer memqry ?an 
proceed at the write and read rates, respectively,, for the memory circuits 
without reducing the pates as a result of contention. An. advantage over a 
FIFO Cijn be obtained with a multiple buffer because £ FIFO involves poth read 
and wr^te operations m the same metjtory $t substantially the same time wh^le 
a multiple Duffer arrangement permits either read Qperations for outputtmg 
from the buffer without write operations or permits writ.e qperations for 
inputting to a buffer without read operations; thereby permitting slower RAM 
circuits and greater pixel rates. . . 

A double ouffer memory can be implemented with the required buffer being 
replicated with double the amoynt or RAM cipcuitry. For example, a 1-line 
buffer configuration, would, be implemented with a double 1-line buffer for 
storing of an image m a first 
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inpu£ buYter and navina precession or commutation ot line Putters netween 
in put and output operat ions. This can reduce memory requirements, such as 



reducing requirements froi p a 6 -line full double buffer to a 4-hne improved 
buffer : yilraina "a reduction in memory circuit requirements Dv'one-Ehira . " 

Mem&^ m&^cypro^aes turther speed 

enhancement in addition Co the scanout .and .re -addressing features discussed 
above. For example, in a display, application image memory can be accessed 
d ur i n g th e fuU u line period . , Blankw afa 

KlankeJ portion . Tnis provides a meaningf ui" speea advantage, such as. a 
ISW-speetf advantage for a configuration, haying 53-microseconds^ per . line 
unblanked period and 63 -microseconds per liije blanked plus unblanked periods. 
This buffer memory featur.e is relatively independent of the type or mempry 
chips available and relatively independent of xhe scanout and re -addressing 
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arrangement . . . „ „ ^ . „ . . . 

Memory architectural features of sequentially accessing a scanline or 

Sixels ana buffering the scanline of pixels for multiple operations at 
ifferent times for each pixel, such as. kernel processing, proyide a memory 
bandwidth enhancen^nt . Tfrese features utilize several characteristics of the 



bandwidth enhancen^nt . These features utilize several characteristics of tne 
experimental configuration. Pixels can be accessed from image memory m an 
o r d er e d f orm, such as ^n^scanXTne t o rn consist 

pixels in"a raster scan CRT monitor , " The, nun^er of pixels to be buttere^rnay 
£e a rel a tively ^ tfte'tgtsj ^gage^memgry cgBacAty, gucfC aa 

j-scaniines o^t ot ji2-scanlines7> of T^ne image m emory, capacjJ^ 

The memory configuration in the experimental display system {las signit- 
icant advantages over other memory architectures. For example, ,it provides 
mpre than a lo-MHz rate for a kernel of 9- pixels, winch is equivalent to a 
pixel access rate of more than 90-MHz (10 -MHZ. kernels times 9 -pixels/kernel) . 
It performs this function using 200-nq RAM ch^ips, implying only, a 5 -MHz pixel 
rate (l/200-ns = 5-MHz) . Therefore, it provides about an 18 -times advantage 
in memory access rate ( 90 -MHz/5 T MHz , = 18 -times) . Alternately, accessing each 
of the kernel pixels at the implied 5-MJIz access rate Provides a kernel 
access rate of (f. 55-MHz (5- MHz/9-pixels) instead of the 10-MHz kernel rate. 
Such an 0.55- MHz rate may be further degraded because the 200-ns access time 
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■ower duty cycle and High er clock rate by puttering accessed infc 

a jputter r memory . For example , in" a di splay system; pixels can be accesse 
fcrqm image i memory at a fl ower clocJc rate "during "the full line period, b 1 " ^ 
?nd unblanJced line t period portions, and pixel's can pe output to :he d 
in ter f ac e ^ unblanked portion of the li; 

not duri ng tne blanked portion oe the line ■ , T ^_ . 



Yankee 



ispla^ 



ion of the line" ani 



not qurm g the planked portion oe the line, , , ^ . . , 

" " important "speed 7 and memory access^ advantages can . fee obtained by 

buffering of information that, win .be used a .plurality. ok times, such as by 
guttering pixel information that will be used" 3 -times tor a„9-kgrnei pixejr. 



guttering p ipse A information that will be used" 3r times tor a..9-kgrnei pixel, 
in this cqht i^rat ion, eac " pixel can Joe used to generate 9 -output pixels, 
where a pixel will be used at each of 9-kernel positions for ^generating 
9 -adjacent pipcels. Therefore, buffering the output pixels .can reduce, memo fy 
access bandwidth by a factor related to the number of times the pixel is 
used, 9-times m thi.s example. . . 

A system requiring a 1(3 -MHz pixe^l rate during the unblanked period of a 
line ana requiring accessing of 9-pixels from image memcjry for .each oytput 
pixel implies a memory access rate of 117- MHz (13-MHz tin\es 9 -input pixels 
tor each" output pixel) . However, accessing of memory .during .the full line 
period (both blanked and unblanked portions) can provide an improvement of 
1,24-timps by accessing of pixels at ab.out a 10 . 5-MHz .rate during the full 
line period, blanked and unblanked portions, (13-MHz times 53- 
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microseconds unblanked period divided by 67 -microsecond for the blanked and 
unblanked period) . Further, the ( buffer memory arrangement discussed herein 
overcomes tne need to access 9 -pixels from image memory to generate a single 
output pixel with a novel buffer memory configuration.. Consequently, the 
buffer memory arrangement discussed herein can provide an improvement over 11 
-times (1.24^ times 9) over a non-optimized arrangement. 
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FIFO Buffer Memory rchitecture 



fifu Butter Memory rcnitecture 

The arrangement discussed above for generating .a sequent lal line of 
pixels "can be adapted, to provide a triple line ~ot .pixels ,£or spatial 

g rocessmo. A single line of pixels can Be converted to a triple line of 
lyeJs with a , look "al^ead pu^f it the memory 

map scanout Is performed a . line ahead jot the display refresh and if 




able m the 3 -scanline buffer. Tpe 3-scahlme buffer can be 

im plemented in various arrangements , such as with a double buffer arrangement 



and with a FIFp arrangement. A FIFO arrangement will now be discussed with 
reference to Ficr 5D 

The arrangement shown in Fig 5D comprises 3- qcanline buffers 513H 
implemented as FTFQs and an output register array 513A implemented to provide 
a ^ -pixel kernel in parallel for spatial processing. The .FIFOs are shown 
connected in serial form so that the next line of pixels being accessed are 
shifted into the lower FIFO channel 513E the present line of pixels, which is 
being shifted out of the lower FIFO channel 513E, is recirculated and shifted 
into the middle FIFO channel .513D; and the present line .of pixels, which is 
beinq shifted out of the middle FIFO channel 513D, is • recirculated and 
shifted into the .upper FIFO^ channel 2.610C. Consequently, the lower FIFO 
channel 513E contain^.the next line of pixels, thelniddlS FIFO channel 5; 3D 
contains the. present .line ofpixels, and the upper FIFO channel 513C contains 
the prior line of pixels. The parallel shifting of all three FIFO channels 
513H makes available the next line, present line, 
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and prior line of pixels; which can be shifted into the parallel register 
arrayJ513A for ^pa.t^al__p_rqcess^ng with processor^ 13^ be loaded 



r 513A for spatial processing with processor _i_b. 
FIFOs can be implemented witR RAM S, where the next address to 
__ -enerated with a write address i coun ter bliiand tne next addx 
accessed is generated with a Tearf address counter bl_F. As pixels ai 
intp the PlPOj T:ne write address counter .LI is increnfented_ to the next 



available FIFO* address. As pixels are shifted out of the FIFO, the read 
address counter 513F is incremented to the next FIFO address to access the 




address. However, if the FIFO gets .overloaded, the read address counter can 
be advanced up to and past the write address counter; thereby overwriting 
important data. Comparitor 513G detects such an overwrite condition ana 
generates an error Signal 513J, such to alert the operator or to override 
input operations . 
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ot tne previous frame, sucn as aurin 
-ystem can Pe configured so that the 
5 greater than the refresh rate of tne di 

..ill have sufficient pixels tor retreshin' , _ — , . __ __,_ — __ ___ 

becomes fully loaded, detected by the read address approaching the write 
address; a disable signal can be generated to disable scanou.t from image 
memory until the display refresh has vacated capacity in the. line buffer. 

The parallel register s 513A can be implemented in a 3-pixel bv 3 -pixel 
array so T:Tiat eg.ch row" ot "three registers "receives A- pixel words from the 
Correspon ding .Line butter channel . Tor example, the top" row of registers (j 7 
lV/apcf 2 receives prior pixel words from the top line Putter channel; t — 
-~ n e row of re gisters 1. 8. and j receives present pixel w< - 



_7~ancf 2 receives prior pixel words from the top ling Putter channel? the 
middle row of registers 77 57 and 5 receives present pixel words from the 
middle iine-~put fir cTiannel .• and "Ine laottom row, ot registers b, _. .ana 4 
receives next p ixel words from the bottom line Putter channel, implementation 
ot EHe paralieT registers Eo" transfer in tlie row direction toward the right 
permits pixel words to be shitted into the register rows from the line Puffer 



.ine 



grogresses. Therefore, only a single pixel need oe snirteo out or eacn.nne 

uf fer channel for a particular pixel period; where the three rows of pixels 

are shifted toward tne right to cause the kernel to shift toward the right 
along the scanlines. 
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The int. 
to the we ~ 
processing 



tensities for the 9-pixels stored in registers 5 13 A can be outp ut 

ighting m ultipliers and adders £121 £__£ sum Of the producE 

tor spatial filtering . 
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Kernel Memory Operations 

. _ Image processing may involve , pre 

intensifi es fo"generat"e a single pixel m 
output .Pixel Xr'Q a display mom cor may 





p^xei to a display m-pnicor may pe a epnvoived sum of the weighted 
ties of a kernel of pixels. A "Kernel ot pixels may Pe a j-Pixel by 
kernel, a S-pTxel Py --pixel kernel . or other .Kernels . The need to 



. _ ______ ... tJ ies that image 

memory must be accessed a plurality of times for a plurality of pixels that 




are to be convolved £or each output ^ 
that processes a '9-pixel kernel t Q 5 
would Tae accessed 9-Qmes tor a ^-PlXg, 



would "be accessed 9-Eimes for a 9- pixei Kernel tor eacn outpup pixel t 

This imposes a memory & requirement oi 9-Eimes tne butpfiE. "pixt _ 

for .the_ image _ memory^ access rat£. u Therefore/ a system ^sinc^such ^ a 

would " 

resolu^j.^*, . , , — . - _ rf — - 

memory speed requirements qind low ou.tput resolution. Fcjr example, a system 
having a 10 -MHz output pixel . requirement and a 9 -pixel kernel spatial 
f^lterinc — J ^ --~ J — 1 ^ — - — — ^ - ^ 



iq output processing requirement would appear to need a 9Q-Myz memory 

pixel access .irate. However, 90-MHz RAM chips m&y have poor availability and 





may be relatively expensive compared to slower Speed RAM chips. 

An arrangement is provided herein using a buffer memory to store Pixel 
accessed from imaae memory at The output pixel rate and proviamcT a Kernel Q 
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c onfiguration permits accessing of a 9-pixel kernel at .. more , than a ^0;ffg? 
rate, yie ffi rate St iore t&an 9Q-MHZ ; " ^-Pixei *ernfl 

times lp -MHzf J EQw$ver7 tn^ 200 -ns 

access time" implying an "equival ent pixel access rate of aDout 5-MHz. This 
yieiag an ^ imprffv^m 4ffi ot^WouT 1¥-Cimes T 5u-MHz7b-MHz ) in Jpory access 
feandwidt n and permits use ot less expensive lower speed RAHS to obt ain 
relatively nigif resoluti on and to support multiple pixel Kernel spacial 
Eilterihgl 
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about a 53-rf^i 

output from t;h_ ^_ _ _ u 

accessed during the unbjanked period ^nd tne image memory may not be accessed 
during the blcSiked period. , However , important advant age? can be obtained by 
accessing image memory during the full'line - period, clurina, both pianKed anS 




jerigd is shorter than the input pe ^ 

can be greater _tfhan/the input_ fate ^Consequent 1 y , j)l?L n image ^memo ry ^gehe ratine 

out] 
exaf 



: input rate can be sfbwer than the. oiitput pixel rate and, hence, the 
put pijcel rate can be greater than indicated by image memory speed. For 
mple, m a system having 
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a 63 -microsecond line period ^nd a 53 -microsecond unblanked portion of the 
line period, a 10 -MHz buffer input rate can be buffered to provide .about a 
12 -MHz output rate because of the greater input period , for loading the 
buffer; i.e., 63 -microseconds ; compared to the output period for unloading 
the buffer; i.e., 53 -microseconds.. This permits relatively slpwer speed RAMs 
tc? be ysed for image memory, which rr\ay be 3 larger memory (i.e.; a 265 , Q00 
pixel image memory; in connynction with a higher speed buffer memory, which 
may be a smaller memory "(i.e.; a 512-pixex line fc>uffer memory); thereby 
efficiently providing high pixel rates with relatively slow speed image 
memory Rams . 
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4/3rds Buffer Memory Architecture . , . , 

The buffer memory features discussed herein are illustrated with a novel 



buffer memory, herein . called a 4/3rds buffer memory, that provides double 
buffer memory capabilities. A double buffer memory duplicates the buffer- 
memory requifeme ifts so that a tirst Butfer memory Can &e m the process oT 
being ", ij ^adgd mil^ ^ ^¥§Qom Wtter memory is" in the, .process ,Qt , being 
ynXo a de 'dT The ,4/3rfls~ft^^ etEicient . tftan a tuju X ftugter 

memQry because it replicates onXy i/ird>^ the xecmnflant. butter memory ; where 



memory because it replicates oruy i/ird pt, the xequnflaflt. butter memory; wher 

3-lines are Leing unloaded while a 4tn-iine is Peincr loadefl 

This "5- line mull: lple fe uttfir . ' implemented as a 4/irds line Punter. 1 



This 3-iine mu ltiple butter implemented as. a — y ^ras. .line putter,. 1 

illustrative, or other mult iple Putter type configurations that aye optimize 
to reduce the amount of memory tro m flouMe to less than dguPle. For/examnle 



to reduce the amount ot me mory trom douMe to less than double. For example. 
the" improved "mul^ can he implemented in !he form or Ik > s 

Puirer. a 5/Brds 5ut£er7 and otner optimized 'multiple Putter cont laurations . 



The optimized multiple .buffer i$ exemplified with a precession 




between input and output buffers; where the i.nput line buffer uses a l-l^ne 
buffer ana th,e other line buffer uses a 3 -line buffer. Line-buffers, line 
buffer-l to line 
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buffer-4, may t>e precessed ir> 




buff;er;-3 is in, the channel -2 position, .and lijie buffer-4 lp in the channel-3 
position. During the, next line operation, line buffer-l is switgh^d to the 
channel-l position, line buffer-2 is, switched to the channel-2 pQsition, line 
buffer-3 is switched channel-3 position, and line buff.er-4 is switched to the 
Input bu ffer position. The 4 -line buffers precess in sequence through the 
input buffer; Sutput buffer channel-l, output buffer channel-2, and putput 
buffer channel-3. and input buffer positiQns . Consequently, a, new line of 
information is being loaded intQ the 1 j.ne-t>uf f ejr m tne ?.nput buffer 
position, the most ^eqent line of information is. being putput iij the output 
buffer ctfannel-1 position, the next most recent, line of information is being 
output in the output buffer channel-2 position, and the ol£ept line of 
mfSrmation is being output in the output Ipuffer channel-3 position. Hence, 
output buffer phannel-1 provides kernel pixels 1. 2, and 3; output buffer 
chaftnel-2 provides kernel pixels 8, 9, afid 4; a{id output .buffer channel 7 3 
provides kernel pixels 7, 6, and 9. For the r;ext line condition, each line is 
shifted end around; where the most recent line of information loaded m the 
line-buffer in t^ie input position is switched to the output buffer channel-l 
position, the line-buffer in the 
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output buffer channel-l pQsition is switched to the output. by ffer channel-2 
position, the line-buffer in the output buffer channe.1-2 position is, switched 
to the output buffer channel-3 pqsition, and tl^e line-puffer iij. the output 
buffer c]ianne^-3 position (which is the ol.de.st information and is no longer 
needed) is switched to the input byff$r position for loading of new line of 
information. This end-around shifting of lines of information causes,, a 
precession of the 4-line buffers to tne 4-buffer positions to provide for 
inputting of a new line of information $nd for simultaneously outpyttmg each 
of the last 3-lmes of mfprmation for implementing a parallel 3 -line 9-pixel 
kernel for spatial filtering. 
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Other Buffer Configurations 
y^riou- 



discussed above to 1 




Gutter o r the present invention can be usea to implement a system. These 
contigura tions "are illustrative ot a large number of otner configurations 



configur ations are illustrative of a large number ot other contigu] 
Enat can be imp lement- ed from the teachingghe rein .~ ~~ . T~ 

" Tne butter of the pre sent invention' has been described in combi. 

with otner novel leaturfes or the present invention, such as a novel memory 
architecture. However . t.he butter 'ot _the present invention can be used with 



architecture. However, the buffer of the present ajiyention can be used with 
Other systems having ot Tier cpntiguratiomT. where the butter ot the present 
invention is not constrained to' use only with the other elements of the 



s ys te m ' ot , the " pre sent invention. . . ~ ~ I . ~ 

The buffer of the present, invention has been described for 
implementation with integrated, circuit RAMS. Alternately, the buffer 
teachings of the present inventi on can be implemented with other memories : 
sucn as rycL i "memories 7 core memories ana phner" types pt memories . Also . many 
ot the teachings associa ted with the butter memory ot the present invention 
can be. utilized with ROMST . ~ " ~ \ ~ 




?e utu^ea with ROMS 
. n The weight memory of t he present 

implemen tation with inte grated circuit , 

teachings pt the present:" invention can be implemented _ with other memories"; 

z-- -- ^cg memories, co re memori es ■ ROMS . PROMS . EROMS . ~ and other types ot 



^gratec 

such as~ccp memories, core 'memor ies . ROMS, proms, EROMS. and other types of 
memories . For e xample the weight memory can be implemented as a weight ROM 
m place ot the weight RAM? 
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fractional, multiple buffers can be implemented, such as a B/3-bufterTr 

ot ^ i/J-putr&r 0 . "tor replacing otnejr integer multiple butters, such „ 

triple butier ins tead or 11 a doucie butter. - ~ /. ~ . . 

The butter of the present invention has been discussed in conjunction 



as a 



with a 9 -pixel kernel spatial .filter. However, the buffer of thg pr^spnt- 
invention can be implemented with other post processor arrangements witn a 
Efiijfirprqfflsor pr ocessor s, s urras 

a 25-piScei Ternei ^ or a 4g-pjxei Kernel processor. 



a 2b-p Ael kernel or a 4 8-pix 
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EXPERIMENTAL SYSTEM 
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EXPERIMENTAL SYSTEM ARCHITECTURE 
General Description 



General description . _ . ^ ^ ^ ^ , . , 

An experimental system is configured with a host computer , a .dJ.gPj.ay 
ymcQsso^^a mswxi, and , a color monitor . frfie nost . muI;^ is augmented 
giKH 'an Slot) bus con* iteration using SlOQ compatible , poarfts . such as Compupro 
hoards? T /ogether wiFn^disK drives .printers , ana other peripherals ♦ 'me ukt 
mpnitor ^s a convent lonaT co^or monitor haying an ana.rog RGB input , shown 



monitor is a conventionaT color monitor haying an ana.fog RGB input , shown 
with monitor documentation included herewith. The flisplay processor and 
memory arrangement is configured , vath a plurality .of wire; wrag^b flariis . xtips 
boards include a ipg^ir DoafdT'SLi ; ^ -memory boaras . BMi ana am ; a rear- end 
HoardT BRlT and a butter board. BBTT 
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Supervisory Processor Interface . 

The interface between the . sup.ervis.ory , processor and , the display 
processor comprises input synchronization signals from tfie display processor 
to the supervisory processor to synchronize the supervisory processor .with 
the display processor operations and output commands from the supervisory 
computer to initialize tne display processor. . . 

Synchronization signals include a frame synchronization signal and a 
line ^cnronizat ion /ignai . Tne TTrarne synchronization s^ignai occurs" during 
vertical retrace ana vertical blanking of the video signal. The line 
synchronization signal occurs during horizontal retrace and horizontal 
blanking of the video signal. An interlaced scan arrangement is used for the 




er the field Is a tirst field or a second fieici bt the interlaced scan? 
Communication between the supervisory processor and the display 
irocessor i)7pertormefl w itn a .4 -port parallel . inter, t ace to a compupro 
Enterracer-Tl boa rd under program control . Each port nas 8-paraiiel input 
.ines and B -par all e J. output lines. The port, assignments .are listed ^n the 



COMPUTER PORT TABLE mclucfed herein. Output signals are .defined as DO signals 
and input signals are defined as pi signals, port j_dentif ication; A, B, or C; 
follows the DO gr DI symbol. Signal line identification follows the port 
identification; i.e., D0A7 identifies output line-7 m port-A. 
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Signal D0A5 controls loading in s.equqntial and random access .form. 
Sequential loading is selected when DQA5 q_s high and random access loading is 
selected when D0A5 is Jow. When D0A5 is high, an output strobe on D0A7 causes 
the pixel address registers to be upd^tec? with the related. slope parameters 
on the falling edge pf the strobe. This ensures compatibility witn the DQA7 
Strobe used a,s a write-bar signal tp write the previous pixel information 
into the previously addressed pixel in im^ge memory. 

SignaJ. D0£6 controls J_oadj.ng and running operations. Running is selected 
when D0A6 15 high and loading is selected when TD0A6 is Jow. In general, DOA6 
is 'high during displaying of images and D0A6 is low during loading of images 
into memory. 

Signal D0A7 strobes the information output with Port-B and. Port-C into 
the destinations. DOA7 is normally low, and D0A7 is pulsed high and then 
pulsed. low under program control to form an output strobe. 

Signal DIAO inputs the frame sync? pulse from the CRT monitor interface. 
Thip frame synp pulse is the .blanking pulse that blanks the CRT monitor 
during the vertical retrace period $nd during a predetermined number of lines 
prior to and subsequent to tne vertical retrace period. This frame sync pulse 
pccurs once per field, twice per frame, in tne interlaced scan System as 
implemented with the demonstration system.. The rising edge of the frame sync 

?ulse, detepted under program c.ontrol, initiates loading of the parameters 
or a new field from the supervisory processor into the aisplay processor. 
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Signal DIA2 inputs the line sync signal from the CRT monitor interface, 
which i s implemented for hardware con trol but not so ftware control m the 
ex perimental" system. 



Signal DIA4 inputs the frame id$ntif icatiQn signal from the CRT mcpnitor 
interface. DIA4 is nigh during the field- 1 period and low during the field- 2 

period, is DOBO through D0B7 output, th.e information to be loaded into the 
destination identified with Port-C This information can be delta information 
to be loaded into t he d el ta registersTpixei aQOr ess fflopauon to P,e t AWfle(i 
into the pixel addres s r e gi st ers7 and Pixel data to be loaded into image 

memory ^ BOCO through D0C7 output the address of .the .destination to l?e 
loaded with the Port-B output signals. The various destinatipns ?re h?ted in 
the TABLE OF DESTINATION ^SELECT ASSIGNMENTS included herein; including the 
4-delta registers each having an MSH ajid an .LSH ; .2-address registers , each 
having an HSH $nd an LSH, data to be written into image memory, and weights 
to be written into a weight table memory. 
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Image Loading 



„ J to a din g ofi an image , into memory is jer^oymed by M ng iJlH Xp f^ 
p-a<g ^ slreg^s^y^ witn "tfie pares s qz 'e^<m "§ixsX p tQ Q be ^Qaaeq, p Efn 
_ utputt»ig the pixel intonation to I ofldgfl" wix h j fefX " ^ tgeg strobing 

load t eature is provided under cont roi ot the DOA5 signal. When tne P0A5 
siqnal is high, a vector can be loaded; where the previously loaded pixel 
address is incremented with the related delta parameter to obtain the next 
pixel address to reduce software overhead and thereby speedup loading of 
image mempry. ^ . . , , • ^ ^ ■ ^ 

Loading of image memory witfr the supervisory processor, is performed with 
a 3-port output arrangement having 8-brts per port.. The first port, Port-A, 
communicates control signals between the supervisory processor and the 
display processor. The second port, Port-B, communicates address and , data 
information to be loaded into the display processor between the supervisory 
processor and the display processor. Tne third port, Port-C, selects the 
reqister or memory m the display .processor for loading. The protocol 
involves outputting of the destination address on Port-CT, output ting of 
information to be loaded into the display processor on Port-B, , and Then 
outputting of a data strobe on Pc?rt-£. The data strobe loads the output 
information into the selected destination. . . , , , . , 

A program to load vectors int.o memory is provided herein ^s the ?ASIC 
PROGRAM LISTING LD.ASC and is briefly discussed in the section entitled 
Software herein. 
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Software 

. n Programs have been developed _tp operate the e xp erimental system and are 
incliiaia!^ 

source programs, that are cpmpiied with a Basic compiler ancj linked with a 
Basic linker to obtain compiled Basic programs. Compiled Basic programs run 
significantly faster that interpretive Basic programs, which maintains . real 
time synchronization betwe.en the display processor and the. supervisory 
p r p c e s for . The source listings may be refedily compiled and linked bv . onfe 
skilled m the art to provide tne compile ^ Basic programs executed to perform 
the image loading and linage processing operations . Tne programs are 
programmed to" be" menu driven, prompting" tne operator to select various 

frperaEpr-seie^ . ~ " _ " T " . ~~ " I 7 

The Basic listings included herein have extensive annotation to teach 

one skilled in the art the features implemented therein. 

The BASIC PROGRAM LISTING LD.ASC provided herein teaches . loading Qf 

vectors into memory. The BASIC PROGRAM LISTING GRAPH . AJ3C provided herein 




experime ntal system disclosed herein under program 
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Description 




PROGRAM LISTING DIS.ASC provides the detailed Basig program 
code for one configuration of the dis_play program. A detailed description Qf 
the code in the T3ASIC PROGRAM LISTING DIS.ASC is .set forth beldw.. This 
detailed description is provided with the pertinent lines of code replicated 
and indented ana preceded by a text description of these preceedmg lines of 



code. The line numbers for these lines of code inb$dded in the text provide 
a cross reference to the correspondingly numbered lines of code in thfe BASJC 
PROGRAM LISTING DIS.ASC provicfed herein. It. should be noted that the* Basic 
compiler and interpreter presently in use interprets an apostrophe 3 as 
terminating the line of code. Consequently any text to xhe right or an 
apostrophe is not 
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executed by the computer. For example, tjie apostrophe permits annotations to 
be entered without Concern for mterf erring .with .executable code. Terminology 
used in the BASIC PROGRAM LISTING DJS .ASCT q_s brief ly defined m the DIS.ASC 
TERMINOLOGY TABLE and is discussed m detail thereafter. 
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"DIS.ASC TERMINOLOGY TABLE" from specification omitted herein 

255 

The following code prints the file name ar*d revision d^te on the terminal for 
verification by the operator of the configuration being executed. 

200 PRINT: PRINT: PRINT 'FILE: DIS.ASC, REV. 10/7/4 19:00" 
The following code clears the program and zero sets the program 
parameters . 

* 240 CI^EAR , , ^ 

The following code selects the system that is . being used, where the 
Murphy system and the Camille system af e. both used with tne image processor 
and where the Murphy system and the Camille system have different keyboard 
add re s s e s 

*260 INPUT "MURPHY (M) OR CAMILLE (C)";K2$ 'SELECT SYSTEM 
CONFIGURATION 

The following code is used to calibrate the joys.ti.cks. The FOR NEXT loop 
sequentially accesses each of the four analog to digital converters (ADCS) 
associated with four joystigk potentiometers and displays the fo.ur ADC 
parameters on the terminal . This code is executed lterativ.ely tp proyicte the 
operator with a continually updated readout on the t.ermmal joystick bias 
controls. When the operator is satisfied w^th tfre calibration, he depresses 
a keyboard switch to exit the joystick calibration routine. 

280 PRINT: PRINT "JOYSTICK BIAS VALUES" 'CALIBRATE JOYSTICK® 7 

300 E%=0 

The following code iteratively steps through the four joystick addresses 
to sequentially access each of tKe four joystick parameters for display to 
the operator. The STEP 2 operation makes tne code consistent with the port 
addresses that 
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are packed into bit positions of the output word haying a binary weighting of 
a factor of two. The B%=A%-2 operation establishes the port addresses 
referenced to zero instead of beijig referenced to unity. The output, of the B% 
parameter with the OUT instruction se.lects one of four channels m the ADC 
multiplexer. The Q% parameter is the inpyt parameter from the selected ADC. 
The GOSUB operation call§ the. subroutine that processes the input ADC 
parameter, wliich is described m detail below. 320 FOR A%=2 TO 8 .STEP 2: 
B%=A%-2: dUT 236, B%: C%=INP (237): QOSUB 440 34Q NEXT A% The following code 
tests for an operator command to exit the -joystick .calibration operation. A 
test is made gf the K2$ parameter to determine if, the Murphy .system or 
Camille system is being used. For the Murphy system, input, port -I is tested. 
For the t^mille system, input; port-93 is tested. The input parameter . is 
masked to isolate zl\e status^ bit and th$ status bit is tested as indicative 
of a keyboard operation. If the. statu? bit is 0- ( set. the keyboard operation 
has not been performed and the iterative processing for -joystick calibration 
is continued. If tfre status bit is .1-set, t.he keyboard, operation has .been 
performed and the iterative jorocessmg for -joystick calibration is exited. 

" ' ^ ' * ' EXIT OF JOYSTICK 

ELSE 660 
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joysticks. The ON GOTO instruction selects the one of four PRJNTT instructions 
Based upon selected joystick, D%. The commas after the PRINT instructions for 
three parameters preempt a, line return. .The absence of; a comma after the 
Y-parameter PRINT instruction causes a line return, which starts each new 
line with a Y-parameter. 440 460 'SUBROUTINE TO ACQUIRE JOYSTICK VALUES 480 
D%=A%/2: ON D% GOTO 500,520.540,580 500 PRINT l, SCALE=";C% / : BS5%=C%: GOTO 620 
520 PRINT "X= n ;C%, : BX5%=Ct: GOTO 620 540 PRINT "ANGL.E= %C% , : BA5%=C%: GOTO 
620 580 PRINT »Y=' ;C% : BY5%=C% 600 PRINT CHR$]li) ; 620 RETURN 640 The 
fpllowing code sets up initial conditions. These initial conditions c$n be 
fixed, as established by the equality statements, or alternately can be input 
by the operator from, a menu with the INPUT statements. PR7$ defines a 
printout command that i$ no longer used. PR9$ defines whether interpolation 
is performed for each field or for each frame (alternate fields) , providing 



either 8 -interpolation operations for 8 -field periods or 4 -interpolation 
operations for 8- field periods respectively. PR7$ is used to evaluate effects 
of mterf olation period or 
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frequency. PR10$ defines whether the renjaincjers fpr the interpolation 
accumulators are cleared for each interpolation, iteration to experiment with 
clearinq of remainders and preserving remainders between interpolative 
iterations. PR11S defines whether , the slope parameters ar§ rounded off to 
inteqers with the CJNT instruction or are processed without the CINT 
instruction to experiment . wit fc different ways of processing the |i°P§ 
parameters. Operator selection of PR7$ t.o PR11$ has been disabled and fixed 
conditions have been define^ with equality statements. 680 PR7 $ =^ N^ t J INPUT 

"PRINTOUT? ' Y' OR ™ " ~~ " 

ALTERNATE FIELDS;' 

'Y' OR 'N'"; PRI0$ , ^v^ v - . . — ~~ ~~ -,- ,. - 

'N'^/PRlls The following code permits the operat.or to select the minimum and 
maximum scale factors for expansion and compression. 760 INPUT "SCALE FACTOR; 
MIN, MAX; .1 To 1500; 10 , 600 1$ NOMINAL" ; PR12 , PR13 The following code permits 
the operator to select the nominal scale factor maximum and minimum values of 
PRI2 =10 and PR13 = 600 by entering a 0,0 for PRI2, PRI3. 780 IF PR12 = 0 OR 
PR13=0 THEN 800 ELSE 820 800 PR12=10: PRI3=600 
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The following cople tests for the interpolative iterations selected and 
calculates tne time scale factor, TS1, as a function of the number of 
interpolative updates, per .each 8-fie^d interpolative iteration .Use of this 
time scale factor is discussed with reference to lines 3260 to 3320 
hereinafter. 820 IF PR9$="Y" GOTO 860 'INTERPOLATE ONCE EACH FIELD OR ONCE 
EACH FpAME 840 TSl = l/4 : GOTO 880 'NUMBER OF TIME SLICES. 860 TSl = l/8.The 
following code permits the operator to selec.t one of two window geometries, 
the new or the old window geometry. The old window geometry. is discussed w^th 
reference to Fi,gs 2C and. 2D. The new window geometry is discussed with 
reference to Figs 2? and 2F. 8$0 INPUT "NEw WINDOW GEOMETRY: .'Y' OR 
'N'";PR32$ The following code permits the operator to select, either integer 
or non-integer translation. Integer translation reduces sc^ntellcition But 
pre-empts subpixel operations. Noi^-integer translation increases 
Scintellation ar& permits subpixel operations. ^00 PR16$="F" 'INPUT -.INTEGER 
(1) OR NON- INTEGER (F) TRASrSLATIOlf" ; PR16$ The following code permits the 
operator to select the offset of the center of rotation as a function of the 
window geometry previously selected. For the old window geometry, TX and TY 
are input. For the new winaow geometry, XI and, Yl are input. These parameters 
provide the X-offset and the Y-offs$t respectively of the center or rotation 
as offset from the XI and Yl coordinates. 
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920 IF PR32$= n Y" GOTO 960 940 PRINT: INPUT "OFFSET CENTER OF ROTATION: 
TX , TY" ;TX, TY : GOTO .980 960 PRINT: INPUT ".OFFSET CENTER OF IMAGE: XJ^.YUl 
;Xl,yl The following code sets up initial conditions. These initial 
conditions can be fixed, as established by the equality statements, or 
alternately can be input by tjie operator from a menu wi^th tjie INPUT 




tract lonal or integer values for the initial point and slope parameters $re 
used. Fractional values are used for subpixel propessing, such as . to provq.de 

1000 PT&l$=nyn 'PRINT: INPUT "FRACTIONAL INITIAL POINT AND SLOPES ■, Y OR 



";PR21$ The following code . establishes conversion factors for degrees to 
radians Cdr) and for radians .to degrees. (RD) . 1020 DR= .0}.7453292#: 



N 



RD=57 . 29577951000028# The following code defines the viewport dimensions; 
which are 512-pixels per line (X5v; and 482-lines per frame (Y5V) for this 
implementation: 1040 X5V=512: Y5V=482 'VIEWPORT DIMENSIONS 
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The following code is an annotation that describes how the X5V parameter 
is derived as a function of the image processor pixel rate. 1060 ADAPT X5V 
FOR PIXEL RATE; (54 US) (9.15 MHZ) (T.6/18 CLOCK WID.TH) The fqllowinq code 

_ «, _ ._ er line x5l) and 

512: Y5I=512 




deleted with apostrophes a81 maintained^ as annotations. 1100 'A 
RI=SQR(X5V-2+Y5V-^) ' UNITS OF PIXELS 1J.20 'A AP1=ATN ( Y5V/X5V) 1140 'A 
A6=ATN,(X5V/Y5V) ,: API=9.0*DR-A6. The following . code defines the image memory 




and 03 in terms of the viewport dimensions^ and in terms of the offset of the 
center of rotation. 1180 Q2- (Y5V/2) -TY: Q3= (X5V/2) +TX 
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1260 KBl=Q2*8: KB2=Q3*8 The following code defines initial conditions for 
scaling prior to receipt of joys.ticlc cqtijm^nds . 1280^ DS11=1 : JSS%=128, The 
following code calculates the initial conditions f or . the center of the image 
memory, XC1 aijd YC1, relative to the center of the viewport and rescales the 
center coorfiinat^s , XCI and ,Ya, apd offset jparameters, TX and TY, to 
subpixel units with the multiplication by eigttt . 1300 XC1= (X5I/2 + ' X1J *B : 
YCl= (Y5I/2+Y1) *B: TX=TX*8: TY=TY*8 The following code sets F6% and.F7%.to 
fixed values with equality statements. F6% is the time-slice counter initial 
condition. F7% is no longer used. 1320 F6.%=I: F7%=0 The following code 
defines the viewport aspect ratio £or scaling .the image as a function of 
rotational position. ThQ aspect r^tio of l.Sff^s a measured .value . fpr the 

§ articular CRT monitor m vfee. This .aspect ratio parameter is empirically 
erived for the particular monitor in use. This parameter is. used m the 
X-scaling and Y-Scalmg processing to compensate for the different scale 
factors in the X-directlori and in the Y-direction dye to the .unequal aspect 
ratio. If such compensation was not provided; during rotation, the image 
would wobulat as the 
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scale factor continuously changed from a minimum vertical and maximum 
horizontal image memory . sgale factor at 0 7 degrees and 180 -degrees to a 
maximum vertical and minimum horizontal . image memory scale . factor at 
90-deqrees and 270 -degrees. Processing of imag_e scale factors with the XSV 
parameter is providedTiereinaf t$r . 134*0 XSV=1.38 'VIEWPORT ASPECT RATIQ The 
following code defines geometric parameters as a function of the window 
geometry selected. The parameters XS, YS, YSS. and . XSVR are scaling 
parameters. The parameters KSAR and K$AR represent the cosine of the angle AR 
£nd the sine of the angle AR, respectively . 1360 IF PR32S= n Y" GOTO 1420 13 80 
XS=256*XSV YS=256 : YSS=YS i (3 . 9O625E-031 : XSVR=1 / (XSV*256 ) 1400 KSAR=0 : 
KCAR=I: XSSV=XS*XSVR: GOTO 1460 1420 XS=256*XSV : YS=256: Y.SS=L 1440 KSAR==0 : 
KCAR=L : XSSV=L The following code gejie.rat.es 16 -iterations through the 
subroutine starting at line 2220 to initialize parameters before starting 
iterative processing. 1460 FOR E%=1 TO 16: GOSIJB 2220: NEXT E% INITIAL 
CONDITION QENERATION Tl^e following cocje causes th,e processor to wait for, a 
0-set vertical sync signal for a fie^d-i condition to synchronize the 
processor with the CRT sync generatcjr. This is performed by first testing the 
vertical sync signal and then testing the field 

264 




by inputting the appropriate word R%,. masking t)ie fielcj signal bit., and 
transferring back to the vertical sync qignal test if the field signal is not 
in the fiera-1 state with the IF THEN instruction. 1480 R%=INP v 236): S%=R% 
AND 1: IF S%=1 THEN 1480 'LOCKUP ON VERT.SYNC^ 1500 R% = INP (236) : $%=R% AND 
16: IF $%=0 THEN 1480 'CHECK FIELD The following code defines the iterative 
processing entrance point for the first iteration ajid for each subsequent 
iteration. For the first iteration, iterative operation commences after the 
proper vertical sync and fielpl conditions have £>een established, as ?liscu$sed 
above. For each subsequent iteration, operation loop? back to this point. 
1520 'ITERATIVE PROCESSING The following code setp the image processor to the 
run mode for every iteratio.n through trie iterative processing return pQiijt. 
1540 OUT 236,64 "The following code cau,ses the processor to xock up waiting 
for a 1-set vertical sync signal as mdigat;ive of the end of tl^e prior fiejfl 
and the need to J-oad new initial conditions for the next field. This is 
performed by testing the vertical syn,c signal by inputting the appropriate 
word R%, masking the vertical sync signal bit, and looping back until the 
vertical sync signal 
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is 0-set with the IF THEN instruction. 1560 ' RE SYNCHRONIZATION AND FIELD 
CONTROL PROCESSOR 1580 R% = INP (236) : S%=R£ AND 1 1600 IF S%=0 THEN 1580 
'LOCKUP ON VERT.SYNC=0 The following annotation describes that the interlaced 
scan calculations are to be processed and describes the input binary bits for 
interlaced scan control. 1620 ' INTERLACED SCAN CALCULATIONS 164Q ' INPUT BYTE 
128 Q64 032 016 008 004 002 001 1660 1 F2 fl LS fS The following code sets 
the image processor to tl\e load mode- to discontinue run operations and to 
load new field information. 1680 OUT 236,0 'COMMAND £jOAD, RUttf-BAR The 
following code causes the prpcessor to determine th$ field condition for 
Subsequent outputting information for the appropriate field. The fi?ld signal 
is tested-by inputting the appropriate word R%, masking the field signal pit. 
and transferring to the output routine appropriate Tor the detected field 
condition, fielcf-1 or field-2with the IF THEN ELSE instruction. 1700 R% = INP 



(236): S%=R% AND 16: IF S%=0 TflffiN 1860 ELSE 1720 ' CHEQK FIELD The following 
cQde outputs the row position ^parameters ; X- axis and y-axis least 
significant half, and mdjit. significant half parameters; f or the f ield-2 
cofiditipn, The pixel position parameters are automatically loaded from the 
row position regisTer^un^^^^^ and Hence neea noFBe loaded 
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under program control . The OUT 236,128 and OUT ?36,0 instructions generate a 
pulse that goes [ From a previously 0-set condition to a 1-set CQnditipn and 
then back to a 0 7 set . condition to pulse the output parameter defmed with, the 
OUT 237 instruction into the register addressed with the OUT 238 instruction. 
1720 ' FIELD-2 1740 'OUTPUT POSITION PARAMETERS 1760 OUT 238, 249: OUT 237, 
CA2%: OUT 236^128: OUT 236,0 'Y-ROW MSH 1780 OUT 238, 250: OUT 237, CB2%: Oyt 
236,128: OUT ^36,0 'Y-ROW LSH 1800 OUT 238, 246: OUtf 237, CC2% : 0<JT 236 . 12 8 : 
OUT 236,0 ' X-ROW MSH 1820 OUT 238, 247: OJjf 237, CD2%: OUt 236,128: OUT $3$,0 
'X-ROW LSH 1840 GOTO 1980 The following pode outputs the row. position 
parameters; X- axis and y.-axis least significant: half $n4 most significant 
half parameters; for the field- 1 condit;iqn. The pixel position parameters are 
automatically loaded from the row position registers under hardware control 
and hence need pot be loaded under program control. The OUT 236., 128 and OUT 
236^0 instructions generate a pulse that aoes from a preyipusly 0-set 
condition to a i-set condition, and then back .to a 0-$et condition to pulse 
the output parameter, defined with the OUT 237 instruction, into the register 
addressed with the 6\JT 238 instruction. 1860 ' FIELD-1 I860 'OUTPUT POSITION 
PARAMETERS 
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1900 OUT 23Bv 249: OUT 237, CAI% : OUT 236,128: OUT 236,0 'Y-ROW MSH 1920 OUT 
238, 250: Ollf 237^. CBI%: OtjT 236,128: OUT 236,0 'Y-ROW LSH 1940 OUT 238, 246: 
OUT 237 , CCll: OU* 236,128: OUT ^36,0 'X-ROW MSH I960 OUT 238. 247: OU* 237, 
CD1%: 0(JT 236, 128: OUT 236,0 'X-ROW LSH Th? following code outputs. th? $lope 

Parameters; X-axis pixel and row and y-axis pixel and row.lea?t significant 
alf and most significant half parameters. This configuration is implemented 
for the slope parameters to loe the same for bpth fields of tne frame. 
Alternately, the OUT 236,128 and QUT 236,0 instruction? generate a pulse that 
goes from a previously 0-set condition to a 1-set condition, and then back to 
a 0-set condition to pulse the output parameter, defined with the OUT 237 
instruction, into the register addressed with the OUT 238 instruction. 1980 
'OUTPUT SLOPE PARAMETERS^ 2 000 OUT 238,242: OUT 237,XPM%: OUT 236,128: OUT 
236,0 'X-PIXEL SLOPE MSH 2020 OUT 238,245: OUT 237,YPM%: OUT 236,128: OUT 
236 0 'Y-PIXEL SLOPE MSH 2040 OUT 238,248: OUT 237,XRM%: OUT 236,128: OUT 
236 '0 'X-ROW SLOPE MSH 2060 OUT 238,251: OUT 237,YRM%: OUT 236,128: OUT 236,0 
'Y-ROW SLOPE MSH 
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2080 OUT 238,243: OUT 237,XPL%: OUT 236,128: OUT 236,0 'X-PIXEL SLOPE LSH 
2100 OUT 238[244: OUT 237,YPL%: OUT 236,128: OUT 236,0 'Y-PIXEL SLOPE LSH 
2120 OUT 238,^40: OUT 237 c xkL%: OUT 236,128: OUT 236,0 ' X-ROW SLOPE LSH 2140 
OUT 238,241: OUT 237,YRt%: OUT 236,128: QUT 236,0 'Y-ROW SLOPE LSH The 
following code selects the run mode to initiate execution of the next field 
by the geometric processor and then callq the mterfield processing 
subroutine to perform interpolation processing, for jthe next field ana 
geometric processing for the next interpolation iteration. 2160 OUT 236.80 
^COMMAND RUN, LOAD-BAR ;PULSE-1 BRACKETING COMPUTATION PERIOD 2180 GOSUB ?220 
'PROCESSING FOLLOWS OUTPUT The following code loops back for the next field 
iteration, to resynchronize with the frame sync signal , to . output the field 
parameters, and to process another slice of the inCerpolative and geometric 
processing. 2200 GOTO 1520 'LOOP BACK FOR NEXT FIELD The following code 
selects tne processing to. l?e performed for the. current time- slice. The 
processing .operations are .divided into eight .operations, eacfr of wftich can be 
performed in a field period, about .15 -milliseconds . The time-sln.ee counter 
F6% keeps track of tY\e next processing to be performed by being incremented 
for eagn field iteration. The ON GOTO instruction selects the next processing 
operation in sequence under control 
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of the. time-slice counter F6%; transferring to the appropriate processing 
operation out of the eight processing operations for the present time- slice. 
2220 ' *******SUBROUTINE FOR INTERFIELD PROCESSING 2240 F6%=F6%+1 ' INCREMENT 
TIME SLICE COUNTER 2260 ON F6% GOTO 4000, 4640, 48,00, 22.80, 2820, 3360, 3440, 
3540 TJie following code, .at the start of the time-slic.e Processing, calls 
tlhe interpolation routines to generate the next interpolated; Output 
parameters. 2280 GOSUB. 5?20: GQSUB 5B40 'INTERPOLATE ?300 The following code 
calculates the XIPI initial point. X- coordinate for field- 1 as a function of 
the viewport centerpo.mt ^-Position, XC1; the rotational X-offset position, 
TX; and the jgeometfric window -parameters, KF4 and KF6 . 2320 ' CALCULATE 
INITIAL POINT 2340 XIPIN%=XQI+tX-KF6 -KF4 'EQUIVALENT TO 

XIPIN%=XCI-$I*8*COS (AS%) /2 The following cotfe provides an alternate 
implementation that detects the need .for X-a*is wrap-apound and controls 
X-axis wrap- around. The IF THEN ELSE instruction tests if the window XIPIN 
parameter exceeds the image memory boundries and therefore determines if 



wrap-around is needed. If needed k the .XIPIN parameter is updated by adding, <?r 
subtractinq the image memory X-dimension 4 KS1, to implement wraparound. This 
wrap-arouria implementation is apostrophied because it has been replaced by 
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another wrap around implementation. 2360 'IF XIPINT@Q THEN 5180 ELSE- 5220 
2380 1 XIPIN%=XIPIN%4.KSIt: GOTO 5300 2400 'IF XIPi;N%>KSl% THEN 5260 ELSE 
5300 'WRAP ARC 2420 - XIPINt=XIPIN%-KSI% The following code calculates the 
Y1P1 initial point y-coordinate for field-1 as a .function of the viewport 
centerpoint Y-position, YCI; the rotational geometric window^ parameters , KF5 
Y-off£tet Position, ^Y; and the and KF7 . 2440 yiPM^YCl+TY+KF^-KPS 
'EQUIVALENT TO YPII%=YC1-RI*8*SIN (A5%) /2 The following .code provides an 
alternate implementation that detects the need fpr Y-axip wraparound and 
controls Y-axis wrap- around. The IF, THEN ELSE instruction test for the 
window YIPIN parameter exceeds the lm^ge memory boundries and therefore 
determines if wrap-around is peeded- yt needea, the Yn;PIN parameter is 
updated by adding or subtracting the image memory Y- dimension, KS2 , .to 
implement wrap-around. This wrap-around implementation is .apostrophied 
because it has been replaced by another wrap-around implementation . 246T) 'IF 
YIPLN%<0 THEN 5380 ELSE 5420 2480 1 YIP1N%=Y1P1N%+KS2% : GOTO 5500 
'WRAP-AROUND 2500 'IF YIPIN%>KS2% THEN 5460 ELSEJ 5500. 252() 1 
YIPIN%=YIPIN%-KS2% Tfte following pode was used to experiment, with buffer 
memory and anti-aliasinq but is no longer used and is therefore 
apostroplied-out . 2540 XIPIN%=XIP1N%-XRN% 'BUFFER MEMORY WITH ANTI -ALIAS INC 
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2560 1 YIPIN%=YIPIN^-YRN% The fo"Owir)g code .calculates .the XIP2 an4 YIP2 
initial Point coordinates for field-2 as a initial function Of the field- I 
Point coordinates and the row. qlQpes. Tfre. scaled slope., P^r^meters, XfN and 
YRN, are added to the field-I lmtm Positions, XIPI and Yipi , rt to obtain the 
field-2 initial Positions, XIP2 ^nd, YIPJ. 2580 XIP2N%@XlPlN%+xRN%* 
(.0-1-5625) 'XIPI-SF=9, XR%-SF=256; 1/2* (8/256) =1/64 2600 YIP2N%=YIPIIjr%+yRN%* 
(.015625) The following c.ode Provides inpi4tti.ng a^nd Processing of joystick 
information - The Operation Of the ADCs is initiated with tne frame sync 
signal going low, as discussed with reference to Figs 6u and. 6V herein. The 
ADCs require less than 100- microseconds to perform a conversion. Hence, the 
ADCs are sampled more, then lQQ-microseconds after the frame sync sig$al went 
low. This time delay is provided by the Output, operations; interpolation; and 
XIPI, XIP2, YIPI, and YIP2 processing preceedmg joystick processing m this 
time 1 Slice' 2620 'JOYSTICK PROCESSOR; MUST OCCUR MORE THAKTlOp- MICROSECONDS 
AFTER FRAME SYNC GOES LOW The follqwmg code outputs the, joystick select 
address to select ti;e ADC to be multiplexed onto tne joystick data bus witph 

the OUT 236 instructiQn. as discussed with reference to pigs 6U £nd 6V herein 

. . . _ . _ __ , _^^_- lct:LOn ^ f our 

consequentially 



and inputs the joystick parameter with the iNp (237) instruction. All . four 
ADCs convert their respective parameters simultaneously and 



can be scanned m 
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sequence one after the other to access all four Joystick parameter^ m the 
same time-slice, as discussed with reference to Figs 6U and 6V herein. 2640 
OUT 236,66: JS^V%=INP (237): OUT 236,68: JSA%=INP (237) 2660 OUT. 236, 70: 
J$YV% = I]tfp (237): OUT 236, £4: JSS%=:INP (237): OUT 236, Bo The following code 
biases the acquirecj 3'OYstick parameters. The BX5 , BY5, BS5, and BA5 numbers 
are the bias calibration numbers measured wheji the keyboard "J 11 key. is 
depressed, performed when the joysticks are m the, centered Positions. 
Therefore, these nu^nbers represent the values .Of the joysticks at the null 
positions. Subtracting of these bias calibration numbers from the measured 
joystick numbers provides the biased and calibrated values of the joysticks. 
26B0 JSXB%=JSXV%-BX5%: JSYB%=JSYV%-BY5% : JSSB%=JSS%- BS5%: JSAB%=JSA%-BA5% 
The following code checks if the rotation, joystick command is outside of the 
deadband; where the deadband is defined witnTDBl and typically fras a value Qf 
20. If the joystick number is within the deadband, the joystick pommand is 
ignored by branching, over joystick rotation command processing with the IF 
THEN instruction, rf the noystick number is outside of the deadband, the 
joystick number is processed/2700 IF ABS ( JSAB%) , CDBI% THEN 2800 'CHECK ^F IN 
DEADBAND 
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The following co£e re- inserts the deadband that wap subtracted- out to provide 
improved resolution, executing the command including the deadband component. 
Jf the rotation command is positive, then the .deadband, parameter is put back 
m by subtraction, if tjie rotation command is negative, then the deadband 
Parameter 'Is Put back xn by addition. 2720 IF JSAB%<0 THEN 2740 ELSE 2760 
'BIAS OUT DEAD13AND 2740 JSAB%= JSAB%+DBI% : GOTO .2780 2760 JSAB%= JSAB%-D?I% 
The following code updates the. angular Position AR with the joystick 
rotational command, *7SAB- The joystick cotpmand is Processed to provide 
?quare-law scaling to introduce a npn- linearity to the command and henge to 
increase the dynamic range. The .linear command is converted to a nonlinear 
square -law command by. irjultiplying the joystick command by its absolute 
magnitude, thereby obtaining a number equal to the square of the command and 
preserving the sign of thl command. 2780 AR=AR+, 7SAB%*ABS (JSAB%) *(. 00003) 




the executive 
" 2800 RETURN 
3 _ o -l -i. t j- wv^^h? u i cdlls the 
mierpoiacion roucmea uu jyenejiaut; uuc hcal interpolated Output parameter? 
The PR9$ parameter branches over the interpolation subroutings calls if 
interpolation once each frame was selected instead Of interpolation once each 
fielcT. 2820 
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2840 11 PR9$ = l, N ,i GOTO 2880 The 286o GOSIB 5220: .GOSUB 5840 'INTERPOLATION 
f ollowinq code calls the keyboard routine to check for keybpard commands to 
exit the iterative Processing or to recalibrate the joysticks. 2880 GOSUB 
4980 'KEYBOARD INPUT ROUTINE The following code conditionally clears the sum 
of the remainders in conjunction with generation the J jie.w interpolation 
iteration under control of phe PRIO$ operator selected condition. This is for 
an experimental investigation to cpnfirm the. effects Qf clearing and of not 
clearing the remainders after each interpolation iteration. 2900 IP PR10S = ,, N 1 ' 
TliEN 2960 2920 SDXIPIR%=0: SDYIP1R%=0 : . SDXIP2R%=0 : SDYIP2R%=0 2940 SDXPR%=0: 
SDYPR%=0: SDXRR%=0: SDYRR%-0 The following code calculates P^rajne.ters for the 
next interpolative iteration. It calculate? .the .delta initial Position 
parameters and the delta slope parameters (b.eginj.ng with D) for interpolation 
By subtracting ea>ch prior parameter (ending, in P) from the related next 
parameter Tending ip. NT. Tjie. (delta initial Position p$ramet?rs represent the 
chanqe m the initial Position parameters over the eight field period of $n 
interpolation iteration. The delta .slope ^parameter 9 represent the change. m 
the slope Parameters over the eight field period , qf n an interpolation 
iteratioTri. 2960 DXIPI%= (XTPIN%-XIPIP%) : DYIPI%= (Y1P1N%- Y1P1P%T 2980 
DXIP2%= (XIP2N%-XIP2P%) : DYIP2%= ( YIP2N%-YIP2P%) 
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3000 DYP%=(YPN%-Ypp%) : . DXP%@ (XPN% -Xpp% ) 3020 DYR%= (YRN%-YRP%) : 

DXR%= (XRN%-XRP%) The following code calculates parameters for the next 
interpolative .iteration. It calculates tt\e .remainders (ending in R) for the 
initial PositiQn delta parameters fbegining with . D) and for the slope 
parameters. This processing works tor both Positive and negative, delta 
numbers, The remainders are calculate^ by Masking the le.ast significant 
remainder bits Of the delta. parameters witji the AND instruction. The mask is 
the number 3 for once per field interpolative updates and. is the nnmber 7 for 
once per frame updates, as controlled^ by the PR9$ condition; masking off the 
subpixel resolution bits of each delta parameter as the remainder. 3 040 
'REMAINDER PROCESSING WORKS FOR + AND - DELTA NUMBERS 3060 IF PR9S = " Y" GOTO 
3180 3080 DXIPIR%=DXIP1% AND 3: DYIPIR%=DYIPl¥ AND 3 3100 DXIP2R%=DXIP2% AND 
3: DYIP2R%=DYIP2% AND 3 3120 DXPR%=DXP% AND 3: DYPR%=DYP% AND 3 3140 
DXRR%=DXR% AND 3: DYRR%=DYR% AND 3 3160 GOTO 3260 3180 DXIPIR%=DXIP1% AND 7: 
DYIPIR%=DYIPI% AND 7 3200 DXIP2R%=DXIP2% AND 7: DYIP2R%=DYIP2% AND 7 3220 
DXPR%=DXP% AND 7: DYPR%=DYP% AND 7 3240 DXRR%=DXR% AND 7: DYRR%=DYR% ANI? 7 
The fQllowmg code calculates parameters fpr the next interpolative 
iteraticpn. It calculates the delta update per interpolation update. For an 
eight time-slice interpolation 
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iteratiqn, each delta parameter is divided by eight so that the total update 
Qver eight update time-slices wi^l egyal .the total delta for that 
interpolative iteration. For a four time-slice interpolation iteration, each 
delta parameter is divided by four so that the tQtal update over four update 
time- slices will equal the total delta for that interpolative . iteration. The 
time-sl?.ce parameter TS1 has previously been, calculated at lines 820 to 860 
to provide the appropriate factor of 1/8 or 1/4 to obtain the delta parameter 
per time-slice pefiod. 3260 DXIP1%=DXIP1%*TSI : DYIP1%=DYIP1%*TS1 3280 
DXIP2%:=DXIP2%*TS1: DYIP2%=DYIP2%*TSI 330Q DXP%=DXP%*TSI : DYP%=DYP%*TS1 3320 
DXR%=DXR%*TS1: D YR% =DYR% * TS 1 The following code returns to the executive 
routine after the above time-slice processing has been completed. 3340 RETURN 
The following code, at the start of the tiipe-slice processing, calls the 
interpolation routines to generate the next interpolated . output parameters. 
3360 3380 GOSUB 5220: GOSUB 5840 'INTERPOLATE The following fcode calculates 
the sine of the rotation angle AR. 3400 KSAR=SIN(AR) The following code 
returns to the executive routine after the above time-slice processing has 
been completed. 342 0 RETURN 
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The following code, at the start of the tipie-slice processing, calls the 
interpolation routines to generate the next interpolated output parameter?. 
The PR9$ parameter branches over the interpolation subroutine calls if 
interpolation once each frame was selected instead of interpolation once each 
fielcf. 3440 3460 IF PR9$="N" GOTO 3500 3480 .GOSUB 3220: GOSUB 5840 
' INTERPOLATE The following code calculates the cosine of the rotation angle 
AR. 3500 KCAR=COS(AR) The following code returns to the executive routine 
after the above time- slice processing has been completed. 3520 RETURN The 
following code resets the time-slice counter, so that the ON QOTO instruction 
at line 2260 can wrap-around from the time- slice at line 3540 to the 
time-slice at 4000. 3540 3560 F6%=0 'RESET TIME SLICE COUNTER The following 



code, at the start of the ta,me-slice processing, calls the interpolation 
routines to generate the next interpolated output ^parameters. 580 GOSUB 52?0 : 
GOSUB 5840 INTERPOLATE, FIRST .OPERATION IN PRIQR TIME SLICE The following 
code calculates the resolved ioyst;ick .translation commands. The joystick 
commands are implemented to "be .in vi.ewport . coordinates . Consequently, 
rptation of the image rotates the image m the image memory relative to the 
viewport, 
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where the joystick translation axis, which are image „ mejnory coordinate 
related, alsa rotate. In. ordqr to reference the translation axes to the 
viewport coordinates, the joystick translation, commands are Ipe resolved from 
imaqe memory coordinates into viewport coordinates by summing the resolved 
components from the image memory coordinates to n obtain the translation 
commands in viewport coordinates. 3600 JSYK%=JSYB%*KSAR : JSXK%=JSXB%*K$AR 
3620 JSXB%=JSXB%*KCAR+J$YK%: JSYB%=JSYB%*KCAR- JSXK% The following annotation 
makes note that the viewport position parameters, XC1 and YC1, should be 
updated prior to calculating the XIP ancT YIP parameters so that the XIP and 
YTP parameters are updated Toased upon the new XC1 and YC+ parameters . 3 640 
T UPDATE POSITIQN; PROCEEDS XIP, YIP PROCESSING The following, code checks if 




If 
the 

X-translatiorT v to* a "^bTiviVnent" 7 number , ""30000 " ili"~thi5""^case~ "tfo r fbrm I 
hard-stop. However, w^ap- around is, being performed, as discussed herein, and 
hence th£> X- translation hard-stop is apostrophied-out . 3680 IF XCI>3000t) AND 
JSXB%<0 THEN 
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7420 'LIMIT X- TRANSLATION, SCROLLING 3700 IF XCl<-30000 AND JSXB£>0 THEN, 7420 
The following code implements X-translation wrap-arqund; causing the image 
processor to wrap-around the XCI parameter at convienent number, 30Q00 m 
thiq case, to form unlimited wrapea- around motion that folds back on itself 
as if image memory was formed as the inside of a sphere. 3720 IF XC1>30000 
THEN 3740 ELSE 3760 ' LIMIT X-TRANSLATION, WRAP-AROUND 3740 XCl=XCl-32760 : 
GOTO 3800 1J(512*8) PIXELS*8 SUBPIXELS-8 SUBPIXELS 376p IF XCl<-30000 THEN 3780 
ELSE 3800 3780 XCl=XCl+32760 The following code re-inserts the deadband that 
was sybtracted-out to provide improved resolution, executing cQtruiiand 
including the deadband component,. If the X- trar^slation command ,is positive, 
then the deadband parameter is put back in by subtraction. If the 
X- translation command is negative, then the deadband parameter is put back m 
by addition. 3800 IF JSXB?<0 TI&N 3820 ELSE 3B40 ^BIAS OUT DEADBAND 3820 
JSXB%=JSXB%+DBI%: GOTO 3860 38£0 JSXB%=JSXB%-DB1% The following code 
implements X-translation integer pixel processing. Fractional selection loops 
abound this integer processing. TTJie previous remainder DXR1, is updated DX1 
with the next command from the X-joystick. The updated remainder DX1 is 
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FIXecl to provide th§ integer part DXIL of the new remainder. The .updated 
remainder and the integer part thereof .are subtracted to provide the 
fractional part DXRI or the updated remainder to be paved for the next 
iteration. The remainder is saved to preclude accumulation o£ error. Then, 
the X-translation position XCI ;Ls updategl with tt\e .integer portion of the new 
remainder to provide the new integer pixel position XCI. 3860 IF PR16$="F H 
THEN 3960 38BO DX1=DXR1+ JSXB%*ABS ( JSXB%1 * ( . 075 ) 3900 DXII=FIX (DXI ) 3920 
DXR1=DX1-DXI1 3940 XC1=XC1 -D5^I1 : GOTQ 398.0 The followipg code updates the 
X-tr^nslational position XCI with the joystick X-translationai command. JSXB. 
The joystick command is processed to provide square-law scaling, to introduce 
a non-linearity to the command and hepce to increase the dynamic range. The 
linear coirimand is converted to a non- linear square law command by multiplying 
the "joystick command by its absolute magnitude* thereby . obtaining a number 
equal to the sguare of the command and preserving the sign of the command. 
3960 XC1=XC1-JSXB%*ABS (JSXB%) * ( .07$) The following code returns to the 
executive routine after the above time- slice processing has Ipeen completed. 
3980 RETURN The follgwing co<3e, at the start of the time-slice processing- 
calls the interpolation routines to generate the next interpolated output 
parameters . 
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4000 4020 OUT 236,65 'OUTPUT START PULSE, . INCREMENT TIME SLJCE COUNTER The 
following code, at the start of the tim^-slice processing, calls the 
interpolation routines to aenerate the nepct interpolated output parameter? . 
The PR9$ parameter brancnes over the interpolation subroutine calls if 
interpolation once each frame was selected instead of interpolation once each 
fielcf. 4040 IF PR9$="N n GOTO 4080 4060 GO§UB 52?0: GQSUB 5840 'INTERPOLATE 
The following code checks if the Y-tr$nslatq.onal joystick command is outside 
of the deadband; where the deadband is,def}.neg. with DBI and typically ha? a 
value of 20. If the joystick number is within the deadband, the joystick 



command is ignored by branching over joystick rotation command .processing 
with the IF-THEN instruction. If the joystick number is outside of the 
deadbandT the joystick number is processed. 4080 IF AB$ (JSYB%) <DB1% THEN 44 Q0 
The following code limites the Y-translation to a conyipnent , number , 30000 m 
this case, to form a hard-stop. However, wrap- around is. being performed, as 
discussed herein, and hence the Y- translation hard-stop is apostrophied-put . 
4100 'IF YCI>3fa000 AND JSYB%>0 THEN 7740 ' LIMIT Y-TRANSLATION, .SCROLLING 
4120 'IF YCl<-30000 AND JSYB%<0 THEN. 7740 The following code implements 
Y-translation wrap-arQund; causing the image, processor to wfap-around the YC1 
parameter at a convienent number, 3000CT lft this case, to form unlimited 
wraped- 
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around motion that folds back on itself as if image memory was formed as the 
inside of a sphere. 4140 IF YC1>30000 THEN 4160 'ELSE 4180 LIMIT 
X - TRANS LAT I ON , WRAP-AROUND 4160 YCl=YCl-32760 : GOTO. 4220 41B0 IF, YCI<-30000 
THEN 4200 ELSE 4220 4200 YCl=YCl+32760 The following code ^-inserts the 
deadband thctt was subtracted- out to provide improved resolution, executnig 
the command including the deadband component. If the. Y- translation, command is 
positive, then the deadband parameter" is put back in by subtraction. If the 
Y-translation command is negative, then the deadband parameter is put back in 




around this integer processing. T?he pi, „ , — — ______ 

with the next command from the "T-^oystick. The up.dated remainder DYT is FIXed 
to provide the integer part DYII of the new remainder.. The updated, remainder 
ancr the integer part thereof are subtracted to provide the fractional part 
DYRl of . t]ie updated remainder to be saved for the next iteration. The 
remainder is s^ved to preclude accumulation of er.ror. Then, the Y- translation 
position YC1 is updated with the integer portion of the new remainder to 
provide the new integer pixel position xCI . 
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4280 IF PR16$="F" THEN 4380 4300 DY1=DYR1+JSYB%*ABS ( JSYB%) * ( . 075J 




$quare-law scaling to introduce a , non-linearity . to the command and henge to 
increase the dynamic range. TJie linear command is converted to .a non-linear 
square- law command by jmiltiplymg the joystick command by its absolute 
magnitude, thereby obtaining a number equal: to the square of the command and 
preserving the sign of the command. 4380 YCI=YC3-+JSYB%*ABS (JSYB%) * ( . 075 ) The 
following code checks if the scale factor, -joystick command is outside of the 
deadband; where tfre deadband .is d^fl^led with T»B1 and typically lias a value Qf 
20. If the -joystick number is w^thm the deadband, trie joystick pommand is 
ignored by branching, over joystick rotatioi; commarid processing with the IF 
THEN instruction. Ir the joystick number is outside of the deadband, the 
joystick pumber is processed. 4400 IF ABS ( JSSB%) <DB1% THEN 462 0 TJie fQllowmg 
coae re- inserts the deadband that was subtracted- out to provide improved 
resolution, execv^ting the command including the deadband.. If che scale factor 
command is positive, then the deadband parameter is put back m by 
subtraction. If the scale fact.or. command is negative, then the deadband 
parameter is put back in by addition. 
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4420 IF JSSB%<0 THEN 4440 ELSE 4460 4440 JSSB%=JSSB%+DB1% : GOTO 4480 'BIAS 
OUT DEADBAND 4460 JSSB%= JSSB%-pBl% The follcpwing code calculates the scale 
factgr update parameter DS11 with the joystick scale factor command, JSSB. 
The joystick .command is processed to provide square-law, scaling, to introduce 
a non-linearity tp the command and hence to increase the dynamic range. The 
linear command is converted to a non- linear square-law command by 
multiplying the noystick command by its absolute magnitude, thereby obtaining 
a number equal to the square of the command $nd preserving the sign of the 
command. Tire scale factor square-law command is scaled witn a small number, 
0.00001, and added to unity to provide an offset binary scale factor. Unity 
spale factor provides no change is size. Hence, adding the scaled offset 

binary scale factor cqmmand to unity provider ~ --<--••---•-- j 

scale factor or a slightly less than unity 




negative zoom. 4480 DSri=l+JSSB%*ABS (JSSB%) * C ♦ 00001) 

BINARY, SCALE, BIAS A$OUT UNITY The following code limits the amount of 
expansion and compression to the values select.ed by the operator .. It . tests 
the XS -parameter and the YS-parame.te.r to confirm that they ^re within the 
selected positive and neqative limits. If w^tliin these, limits, scaling 
processing is performed, rf not within these limits, scaling processing is 
looped over. 4500 IF DS11<1 AND XS<PRI2 OR DS11<1 AJOTD YS<PR12 

285 

THEN 4620 520 IF DSII>L AND XS>.PR13 OR DS11>1 AND YS>PRI3 THEN 4620 4540 
XS=XS*D$11: YS=YS*DS11 The following gode updates scale factor parameters as 
a function of whether the old processing or the new processing was selected. 



4560 IF PR32$="Y" GOTO 4600 ' 4580 YSS=YS* (3 . 90625E.-03) : XSSV=XS*XSVR: GOTO 
4620 4600 KB1=KBI*DS11 : KB2=KB2*D$11 The following code returns to the 
executive routine after the above time-slice processing has been completed. 
4620 RETURN The following code, at the start of the time-slice processing 
calls the interpolation routines to .generate the next interpolated output 
parameters. 4640*4660 GOSUB 5220 : GOSUS 5840 INTERPO. CALCULATIONS PERFORMED 
IN PRIOR TIME-SLICE The following code calculates the KB4, KB5, KB6, and KB7 
parameters as a function of whether the old processing or the new processing 
was selected. 4680 IF PR32$="Y" GOTO 4740 4700 KF6 =KB2 * KCAR* XS S V7 
KF7=KBI*KCAR*YSS 4720 KF4=KB1*KSAR*XSSV: KF5=KB2*KSAR*YSS : GOTO 4780 4740 
KF6=KB2*KCAR : KF7=KBI*KCAR 4760 KF4=KB1*KSAR : KF5=KB2*KSAR 
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The following code returns to the executive routine after, the above 
time-slice processing has been completed. 4780 RETURN The following code, at 
the start of the time-slice processing, calls the interpolation routines, to 
qenerate the next interpolated, output parameters. The pR9l$ parameter branches 
over the interpolation Subroutine calls if interpolation once each frame was 
selected instead of interpolation once each field. 4800, 482p IF PR9$="N" GOTO 
4860 4640 GOSUB 5220: GOSUB 5840 'INTERPOLATE The following code generates 
the slopee parameters as trigonometric .functions of . the, scale factor 
parameters XS and YS. The. CINT instruction is conditionally used as a 
function of operator selection, as discussed above. 4860 IF PR11$="N" THEN 
4920 4880 YPN%=CINT (KSAR*XS) : XRN% =CINTj2 * KSAR* YS ) 'CALCULATE SLOPES 4 90 0 
YRN%=-CINT(2*KCAR*YS] : XPN%=CINT KCAR*XS) : GOTO 4960 n 4920 t JPN%=KSAR*XS : 
XRN%=2*KSAR*YS 'CALCULATE SLOPES 49.40 YRN%=-2*KCAR*YS : XPN%=KCAR*XS The 
following code returns to the executive routine after the above time- slice 
processing has been completed. 4960 RETURN 
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The following code interrogates the keyboard, where the port is defined as a 
function of the system selected, The J-key selects joystick recalibration . 
The DELETE-key selects return to the operating system. The ESCAPE-key selects 
return to the DIS.ASC menu. 4980 5000 IF K2S=*C" THEN 5040 ' KEYBOARD COMMANDS 
5020 A7%=INP (1): AB%=INP \0) : GOTO 5060 5040 A7%=INP 1931: A8%=INP (92) 5060 
A7%=A7% AND 2: IF A7%=0 THEN 5200 'DATA READY TEST 5080 AB%=A8% AND 127 'MASK 
PARITY BIT 5100 A9%=AB% XOR 27: IF A9%=0 THEN 240 'ESCAPE TO MENU 5120 
A9%=A8% XOR 74: IF A9%=0 THEN 5140 ELSE 5160 *"J" TO RECALIBRATE JOYSTICKS 
5140 BS5%=JSS%: BX5%=JSXV%: BY5%=JSYV%: BA5%=JSA%: GOTO 5200 5160 A9%=A8% XOR 
127: IF A9%=0 THEN 5180 ELSE 5200 'DELETE TO CP/M 5180 SYSTEM 5200 RETURN The 
following .code provides the .interpolation processing per time-slice. The 
interpolation processing was divided inot . two subroutines so that . they could 
be partitioned between time-slices to optimize . performance by minimizing the 
number pf time-slices. However, both subroutines are called from the same 
time slice in 
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this program because the performance is appropriate . 5220 5240 'INTERPOLATION 
SUBROUTINE- 1 5260 'UPDATE INITIAL POSITTONS AND SLOPES The following code 
accumulates the sum of the remainders by adding the new remainder to the 
prior sum of the remainders to obtain the new sum of the remainders for each 
position and slope parameter that is to be output. 5280 'REMAINDER PROCESSING 
5 3 00 SDXIPlft%=TSDXIPlR%+DXIPIR%: SDYrPIR%=SDYIPlR%+DYIPIR% 5320 

SDXIP2R%=SDXIP2R%+DXIP2R% : SD Y I P 2 R% = SD Y I P 2 R% + D Y I P 2 R% 5340 

SDXPR%=SDXPR%+DXPR%: SDYPR%=SDYPR%+DYPR% 5360 SDXRR%=SDXRR%+DXRR% : 

SDYRR% =SDYRR% +DYRR% The following code calculates the new parameters by 
adding the delta parameter to the prior, parameter to get the new parameter 
for the current time- slice for each position and slope parameter that is to 
be output. 5380 'INTERPOLATION DELTA UPDATES 540CT XTP1P%=XIP1P%+DXIP1% : 
YlPlP%=TYIPIP%+DYIPl% 5420 XIP2P%=XIP2P%+DXIP2% : YIP2P%=YIP2P%+DYIP2% 5440 
XPP%=XPP%+DXP%: YPP%=YPP%+DYP% 5460 XRP%=XRP%+DXR% : YRP%=YRP%+DYR% The 
following processing tests each sum of the remainder parameters to determine 
if it has an integer portion, being greater then the eighth pixel resolution 
of the processing. If not, operation proceeds to the next operation. If yes. 
the sum of the product parameter is decremented by one pixel to eighth pixel 
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resolution and the related initial position or slope parameter is incremented 
by one pixel to integer pixel resolution. 5480 IF SDXIP1R%<8 THEN 5520 5500 
SDXIP1R%=SDXIP1R%-B: XIPIP%=XIPIP%+1 5520 IF SDYIP1R%<8 THEN 5560 5540 
SDYIPlR%=SDYIPlR%-8: YIP1P%=YIPIP%+1 5560 IF SDXIP2R%<8 THEN 5600 5580 
SDXIP2R%=SDXIP2R%-B: XIP2P%=XIP2P%+1 5600 IF SDYIP2R%<8 THEN 5640 5620 
SDYIP2R%=SDYIP2R%-8: YIP2P%=YIP2P%+1 5640 IF SDXPR%<B THEN 5680 5660 
SDXPR%=SDXPR%-8 : XPP%=XPP%+1 5680 IF SDYPR%<8 THEN 5720 5700 SDYPR% = SDYPR%-8 : 
YPP%=YPP%+1 5720 IF SDXRR%<8 THEN 5760 5740 SDXRR%=SDXRR%-B : XRP%=XRP%+1 5760 
IF SDYRR%<8 THEN 5800 5780 SDYRR%=SDYRR.%-8 : YRP%=YRP?+1 5800 The following 
code returns to the time-slice routine that called the interpolation 
subroutine. 5820 RETURN The following code performs further interpolation 
processing. 5840 5850 'INTERPOLATION SUBROUTINE-2 
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The following code formats the output parameters in response to the updated 
position and slope parameters. The formatting generates the LSH parameters by 
ANDinq each parameter with an LSH-mask to preserve the 6-LSBs ana to ,mask-out 
any MSBS . The formatting .generates tfcff MSH parameters tjy scaling^ e^ch 
parameter with 1/64 or 0.TJ15TS25 and taking the integer pprtpion thereof with 
the inteqer symbol ■'%■' to place the MSBs, into the LSB position of the output 
parameter. Integer or non- integer (fractional) parameters are generated under 
Control of the PR2l$ select ign parameter, rf non- integer parameters are 
selected, the 3-LSBs are maintained with a mask of 64. If integer parameters 
are selected, the 3-^SBs are set to zero with a mask of 56 and the 3- LSBs of 
the MSH are masked with a mask gf 60. 5860 ' FORMAT INITIAL POINT OUTPUTS 5880 
IF PR2l| = »N» THEN 6020 5900 y CA1>=YIP1P%* Y. 0156257 : CB1%=YIP1P% AM) 63: 
Ccl%=XIplp%* (.015625) : CD1%=XIP1P% AND 63 5920 CA2%=YIP2P%* ( . 015625) : 
CB2%=YriP2 J P% AND 63: CC2%=XIP2P%* (. 015625 ) : CD2%=XIP2P% e AND 63 5940 ' FORMAT 
SLOPE OUTPUTS 5960 XPM%=XPP%* . 015625) : 0 XPL%=XPP% AND 0 63: 
YPM%=YPP%* (.015625) : YPL%=YPP% AND 63 5980 XRM%=XRP%* ( . 015625] : XRL%=XRP% AND 
63- YRM%=YRP%* ( .015625) : YRL%=YRP% AND 63 6000 GOTO 6140 6020 ' FORMAT IP AND 
SLOPE AND TRUNCATE TO PIXEL RESOLUTION 
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6040 CA1%=YIP1P%* ( . 015625) : CB1%=YIP1P% AND 56 : CC1%=XIP1P%* ( .015625) : 
CD1%=XIP1P% AND 56 6060 CA2%=YIP2P%* (. 015625J : CB2%=YIP2P% AND 56: 
CC2%=XIP2P%* L 015625) : CD2%=XIP2P% AND 56 6080 XPM%=XPP%* ( . 015625) AND 60: 
XPL%=XPP% AND 0: YPM%=YPP%* ( .015625 AND 60 : YPL%=YPP% AND 0 6100 
XRM%=XRP%* (.015625) AND 60: XRL%=XRP% AND 0: YRM%=YRP%* (.. 01562.5 ) AND $0: 
YRL%=YRP% AND 0 6120 The following cpde returns to the txme- slice routine 
that called the interpolation subroutine. 6140 , RETUpr The following code is 
an END statement placed at the end of the listing. 6160 6180 END 
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Circuit Boards , , . , . ..^^^ 

. Th e experim ental system x^.mplem^t.e.d w.ith wrap cirruxt feogrflg 

consisting St 2^Mem^^ "i-^oqic : BoarOT ( BL1 ) . 1-B^ttgr 
Board I and 1-TkVar Md Boara t ff iajTV bacn Jpoard is "cons true tea with a 

Vector board, manutactureel by Vector , Electronic Cotrpany of Sylmajr CA, having 
1/lOth inch hole spaemgs on a 17-mgh by 8 1/2 -inch board. Wire wrap DIP 
sockets and cable connectors ^re inserted into the Victor board" and 
interconnected with wire wrap interconnections. Information on the, DIPs 
plugged- m to the DIP sockets is provided for selected, boards in the printout 
of The TABLE OF DIP LAYOUT ON BOARDS included herewith.. Information on the 
cable connectors .is provided fpr each cable in the printout of the CABLE 
CONNECTION TABLE included herewith. , . 

DIP assignments are provided for selected boards xn the TABLE OF DIP 
LAYOUT ON BOARDS included herewith, for e^ch board. DIPg are arranged on the 
boards as rows .identified wit;h alphabetical symbols; i.e., A to ~E; arjd.as 
columns identified wa,tli numerical symbols; i.e., 1 to, 23. Each DIP position 
on a boaird is identified with a u symbol followed by the column and row 
symbols (i.e., U3A) . . . ... . . 

Logical sqhematic diagrams showing implementation of the . experimental 
system are provided h$rewitn, $uch as . shown in Fig 6.. These logical diagrams 
snow standard commercially available integrate^ c.xrcux.ts; such as TTL series 
7400 IPs, Mitsubishi M5 8T725 HAIV[S, and 8216 bidirectional bus dfiveps, and 
Syg^ietics .8T97 buffers. Specif igatipns for these integrated circuits are 
available in catalogs and specification sheets from the 
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abovementioned manufacturers and are wej.1 known in ti\e art. 

The schematic diagrams show the logical function in symbolic form, iden- 
tify the type of IC, identify the DTP numbers and pin numbers, and show 
wiring interconnections between DIP and pin numbers. Device types are often 
?hort-er}ed, such as shortening the name 74LS02 to LS02. DIP assignments are 
identified with U number?, such as U20C representing the DIP. at row-20 
column-C on t;he subiect circuit board. For example, a UOR-gate is shown at 
the top portion of Tig 6B identified with tfte . designation LS0.2 as .being a 
74LS02 quad NOR-gate integrated circuit, identified with the designation U21C 
as being ^Locatea on the BL1 cirpuit board at row-C column-21, and having 
2-input signals on _pin-ll and pin-12 of the DIP and one output signal on 

Ein-13 of pie DIP. The input t.o pin-11 is shown connected to che output of 
IP U2?B pm-3, the input to pin-J.2 is shown connected to the output Qf DIP 
U20B pin-12, and the output frpm pir>-l3 is shown connected to DJP U7D pin- 9. 
For convenience of documentation, interconnections may be designated by the 
DIP identification number and pm number separated by a da$h; i.e., U21C-13 
representing pin- 13 of DIP U21C. For convenience of discussion, logical cir- 
cuits may be designated by the DIP identification nymber and the output pin 
number separated By a dash; i.e., U21C-13 representxng pin-13 of DIP U21C. 
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Cable List 

A cable list is provided. j.n the CABLE CONNECTION TABLE included 
herewith. This cable list identifies the cables between the various Vector 
boards and between the Vector boards and the supervisory processor. Each 



cable between display processor boards is implemented .with a 50 -pm ribbon 
cable having odd pins connected to ground for signal lSQlation. Each calple 
between the "Vector boards and. the supervisory propessor is .implemented. with 
an RS-232 type 25 -pm ribbon cable, consistent , with the „ signal 
representations for the Compupro Int.erf acer- II board. The cable list 
identifies the pin associated y/ith a signal, a symbol associated witlj the 
signal, a description of .the .signal, a representative source of the signal 
ana a representative destination of the signal. 
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S-100 Bus System , , , „ ^ . , 0 , ^ • , 

The experimental sys tem has been implemented with an S-100 bus based 
system pertoming superv isory processor Tunctioflg 13 conjunction ^w^th th^ 



performing supervisory processor junctions *P fiP^W^wSlkJ 1 Q m 0 

cfttware and nafdware.m herein" Jfoqjs-lW SVSt eing 

een conFigureg" the Lamiiie" system ana tne Murpnv, svst 



novel 



y system. "Tne 



contiguration ot ffie (jamilie system will Be discus nereiriatterl 
The camiiie system " compr ises' a computer, a pair ot tlopov disk drives, a 

-.n-- ^ t- -1 implemented with an * ^ ~ 

in coniunction with 



in an enc 



disK drives are 
Igsufe and operating in" conjunction w 
Tha disk drives are' manutactured £>y s: 



om puter . Tti e di sic drives 
rive enclosure , . is___ln; 



air of 8 -inch disk drives 



are manufactured By Siemens as the TO ' 1 

gnuf actured by mternational instrum 
ont rolle r ~i g _ m^nu^c^u red * ' " 9TC?B u :g?9. . 



^ ^. the 

trumentation. 
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Applied 
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al DataS 



macron?. 
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"include a dot matr ix printer manufactured^ pv fetar 
tne "Gemin i -lu . a dot matrix printer manutactured Dv Epson 
^ daisy^neel printer mgnutactuxefl, J&y.Smigt r^QgC^rgS tft| 



lpu . and a daisywheel printer manutactured T5v~l 
despise d in detail in tne re^erenced_ manual 



implemented witn ~a~ cabinet "manutactured joy Fulcrum Computer Pro 
I8ua5 fl^c FQCQ^uter "system _ cabinet and3ngyina_ a DacKpi^ne S-TW 



renced manuals 
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The .computer xa implemented with yar 
i pugro lpc ading the raraffiotitT l^iTTpoardr. 
;ystem Su pport "board, and a pair ot mte 



Tdq manufactured by 

" memory poardJi 





CO! 



stem Sup port "board, and a pair ot intertacer 2. boarl 
d is i usM to interlace to tne terminal and printers 
ard provides the 3 -channel parallel interface to th> 
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~-n the reterenced manuals - ~~ . 
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is 



33 



ing system is 



a is described in detail in the 



reference 



fre l f P Pi^ under Easier which is described in detail 



in thir eterenced T documeiats 
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The following documents provide supplemental data on the compyter system 
and are herein incorporated by reference. 1. Technical Manual, Siemens, OEM 
Floppy Disk Drive FDD 100-8, Technical Manual, J/Iodei 100 T 80. 2. Manual, 
International Instrumentation, Incorporated, universal Disk Enclosures, 
General Information/Pricing, 1932. 3. User, Manual, CompuPjro Division of 
Godbout Electronics, Disk 1 Arbitrated 24 Bit DMA Floppy Disk Controller, 
1981. 4. User's Manual, Applied Digital Data Systems, Inc., Viewpoint/3A 




^ ~ r --, sion _ . _ . 

Manual, CompuPro Division of Godbout fijeptronics, 8085/8088 CPU Dual CPU, 
2/83. 10. Technical Manual, Compupro Division of Godbout Electronics, RAM 16 
static memory, 4/82. 11. Technical Manual, CompuPro Division of Godbout 
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Microsoft, 1 9 7 "9 . 1§ . Microsoft Basic Compiler Documentation, published by 
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LOGIC BOARD 



Control Logic . , _ _ n n . 

various control arrange m e nts can be provided f or controlling operation, 
For example: counter. lidM^ 



een 



This 
Figs 



6B to 6D 



The gated clock cpntrol logic shown in Fids 6B to 6P contr o ls the clock 
pulsesto' various i Toaic device^ 7 such as address generators , memories , and 
other" devices^ to crock "the various operations associated therewith. For 
exam ple^ t M write strobe W - Kar to He memories is generat ed 

cj-p dKs "bp varibuY U21C. U2QC, U19C, U19D.. 

fti fiffj" \m. an J mm* ^ ot clocks are qe nera^gd 

at different tVnfes ana are cont r oll ed tc T Be , non-con^ 

clocks;- Load clocks are genqratecf under computer control to load compute r 
generated" paramet ers into various registers. Address generator clocks cao^be 
generated under control ol external sync pulses. High speed clocks can be 
generated: under control ot various signals to generate addresses that are not 



generated under gontroi ot various signals t"o generate 'addresses that are not 
in contention "with "other signals" genera ting criocKs and are not generated at 
times that such addresses are not~needed~ 
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The logic composed of U18D-6, U22B-3, U21E-6, V19B, U20B, <=md U21D-6 
(Fig 6B) is controlled by the completer for , generating strobe signals and 
control signals for loading comput.er lnfonnatiori into tne address generators 
and for disabling operations during loading of computer information. Logic 
qates U20C and TF2IC (Fig 6B) gate the comput.er strobe to load delta 
registers. Logic gates Ur9C, uigb, and U18£ (Fig 6B) gate various . clock 
signals to load and update R-registers. Logic gates, U9A and U10A (Fig r 6B) 
gate various clock signals to load and update F- registers. Flip-flops U22E 
and associated logic U20D-4, U22A-4, U1BD-8, U21E-4, TT15A-3, U22CT-3. U20D-13, 
U18D-2, U21E-10, U18E-6, tf20D-l, IJ21E-12. U19D-4, UIBE-3, U21D-3, U20E-6, 
U17A-8^ U17A-11, U22A-2, U13A-8, U21E-2, 0205-3, and other related elements 
(Fig 6D) synchronise and process the sync signals CFS and CLS to generate 
clock and control signals for processor operation. Logic gates and flip-flops 
U12A, U21D-8, U18E-3f U14A-2. U14A-4, U16A-3, U17A-3, U16A-6, U17A-6. U13A-5, 
U23C i 10, U14A-6, U20fc-ll, U2iB-5, Ul^A-11, U21B-2, U21E-8, aijd related , gates 
(Fig 6C) control tl^e gated clock pulses for $ddre$s generation operations. 

The computer interface signals are defined in xhe tables of computer 
interface signals; PORT-A, PORT-B, AND PORT-C. Port-A input and output 
signals are control signals. Port-B output, signals are address, and data 
signals to load mtQ tne selected destination. Port-C output signals are 
destination select signals. 
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Computer loacj logic will now be discussed with reference to Fig 6B. 
Computer control signals DOA6 and P0A7 control loading of mitral conditions. 
When Q0A6 is l-se~t, run operation is commanded and, loading of .initial 
conditions from the computer Vitn the lQad $trol?e D0A7 is disabled with gate 
U22B-3. When DOA$ is 0-set, run operation is disabled and load operation is 
enabled through inverter .Ul8D- 6 by enabling gate U22B-3.to pass an inverted 
computer strqbe DOA7 as signal U22B-3. Tl\xs gated strobe is used to clock the 
selected register, steered with the register, address decoders U19B and U2QB 
to gates UZ1C, U^OC, U19C, and U19D. The inverted D0A6 signal U1BD-6 is 
inverted with U21E-6 to generate the DIEJN-bar signal for memory r§ad $nd 
write operations . When D0A5 is high, defining, the run mode; DIEN-oar is high 
establishing the memory r§ad mode, when DOA6 is low, defining the load mode; 
DIEN-b^r is low establishing the memory write modq. DlEN-bar control 
operations are discussed m detail with reference to Figs 6E to 6N for the 
memory logic. . . . . , 

write signals U22C-6 and U22C-8 control writing into a peripheral RAM by 
enabling write pulses W2 and W3 when addressed through Ur9B-I0 and U19B-9 
respectively. 

Gate U22C-11 is an OR-g^te that is enabled with the address of the 
memory U19B-11 to load data into the memory for steering of the computer 
strobe U22B-3 to generate a write strobe to load the computer generated 
parameter into memory. 

Gates U20C and U21C are NOR-gates that are enabled with the destination 
register address signals from U19B and U20B to select the delta register to 
be loaded by steering of the computer strobe U22B-3 to clock the appropriate 
delta register to load the 
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computer generated^parameter^ into^the selected v register . _^ ^ ^ ^ nd 



. A master clock shown a s CPE-bar (Fig 6D) is f armed-out, gated 

a pplied Eo tne synchron ous elements^ jne tgF- ter qiocic is derived t: 
clock pu lse generator and communicated to^ the logic hoard on cable 



clock pulse generator and communicated to the logic hoard on cable H^ffi^ 
Alternately, "clock: CPE-bar can he generated with a gplt -contained clock 
generating' operating asynchronously with reference to" th e external ciockTEo 




i operation, vqx example, ESS 

requency consistent with the 



requirem e nts of a sync ge nerator for the CRT monitor, which mav not be an 
o pgimum clock rregjilncy a £o r fhe address" generators" 'me re tore, a separate 
clocl can W provided J having a u cl ock : t ^ecraencv that ^ Tor the 



clock can he provided- ha v vng a clock t frequency that is optimum tor the 
address generators in place or the external c x OCK . 

Clock loqic will now oe discussed with reference to Fig .6D. The clock 
CPE-bar is logically processed to clock synchronous . elements in the address 
generators at the sami time. For convenience of definition, clocking occurs 
It the rising edge of the delayed clock pulse CPD, which is delayed, by 2 -gate 
propagation delays after the early clock CPE-bar and one inversion of the 
early a clqck PPB-h&r For example CfrE-bar propagates through inverter U21B-2 
and fron- inverting jU ^ - aaKe™^ 

U12A-6 TFig SC) , providing one stage of delay and onfe stage of inversion, and 
by non-inverting gates U9A-6, U9A-8j IJlOA-ff, 

and U10A-8 (Fig 6B) to provide the 2-propogation delays and the single 
inversion from \he early clock CPE-bar to the clock signals for registers 
U8D, U9D, U5D, , UBE, UBE /and U9E. — • , ^ , 

In one display , configuration, register U22E is used., , to synchrcpnize 
operation of the logic with a frame sync signal (TFS a,nd a. line syng signal 

c£s. A short , " — 3 — fc ~ a "~ " 

signal CLS . 

!nd C CLSRl U re^ Latched 
line sync signal CLSRI then lat.ched m flip-flop D22E-15 one clock period 
later for a delayed line sypc signal CLSR2 . The delayed line, sync Signal 
CLSR2 U22E-15 is inverted with inverter U21E-10 and NANDed with the non- 
delayed line sync signal CLSR1 with NAND-gat,e U18E-§ to generate a short 
inverted pulse bracketing the .first clock period, of line sync signal CFSRI . 

Clock signal CPE-bar (Fig 6D) is gsfted with NAND-gates U12A- 8 $nd 
U12A-6 (Fig 6Cj to generate a gated clock signal for address generation which 
is performed with registers y8D, U9D, U5D, TJBE, U9E, and USE. Gating of the 
clocks to these registers witl> AND-gates U9A-6, U9A-8, U10A-6, and U10A-8 
gates address generator operations. ^ . . <nn ^ 

Control logic for a display configuration will now be. discussed with 
reference to Fig 6D. Signal U13A4 is a. clock ga.te cpntrol signal for gating 
the address .generator clocH, as described herein with reference to Fig 6C. 
This gate signal is comprised of three components; U17A-8, U17A-11, and 
U^22A.— 4. 
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The^e coi^pone 



conjunction wi 





ififcS 



te sync signals to enapie tne address generator ciock tnrouan 

:Ls present .Gate U2 0 E - 6 AND s togetner the inverted f rame sync 
through inverter U18D-8 ancj the line, sync signal. Gate U17A-8 



NANDs together U20E-6 and the delayed line sync signal CLSR4 to enable the 
address generator clock thrcjugh U1JA- B. Gate U17A-1.1 NANl?s together U20E-6 
and the undelayed inverted line sync signal CLSRI through inverter U22A-2 to 
enable the address .generator clock through. Ul 3 A- 8 . 

The ELS signer U15A-3 controls multiplexers U1QD, U11D, U12D. U10E, 
U11E, and U12E fFig 6D) . During the appropriate portions of the load mode, 
the address generator P-registers are loaded from the address generator 
R- registers under control of the ELS signal. During other periods of time, 
the address generator P- registers, are updated £rom tjie related , delta 
registers under control of the ELS signal. The EJjS signal is disabled, by the 
sequential load control signal DOA5 inverted, with U21E-4. This permits . the 
P-registers to be updated from the delta registers to generate vectors into 
memory, such as for a display configuration. The ELS signal is strobed with 
a sfrort pulse U19D-4 during: tl)e loacj mode DOA6 as controlled .with U22C-3 . 
During the load mode, the ELS signal is enable^ with DOA6 enabling U22C-3.to 
pass the short pulse U22C-2. The short pulse is generated by the early line 
sync signal CLSRI U22E-12 .and the 
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thrice delayed line sync signal CLSR4 U22E-7.for a 3 -clock peripd transfer 
pulse to transfer information from the R-registers to. the P-registers. The 
3-period pulse U19D-4 is generated when CLSR4 U22E 7 7 is low ar\a when CLSRI 
U22E-10 is high, as inverted with U21E-12 .to define the period that the 
undelayed line sync signal CJjSRI .has. gor;e high and tjefore the delayed line 
sync signal CLSR$ has gone high; indicative of the first 3 -clock periods at 
the start of a line sync Rulse. 

The XA3 and XA3-bar signals are shown gated with U19A-1 ,to disable both 
the XA3-bar signal and hence memory board- 1 and tfte XA3 signal arjd hence 
memory board-2 with gates U19C-13 and U19C-4 respectively. This proyides for 
blanking of the display and clearing pf the buffer memory by outputtmg zeros 
from the disabled memory board when either the frame sync signal CFSRI or the 
sequential loa.d signal DOA$ are true. U19C-1 digaBles tne memory boards 
during sequential loading with DQA5 U19A-3 $nd during the vertical olankmg 
period with the inverted CFSRI signal from inverter U18D-8. 



Registers U22E and U23C are used .to latch signals. U23C-2 and U23C-5 
latch signals C2-30 and C2-32 .to provide, latcfied signals C4-32 and C4 7 36 
respectively. U?3C-10 is used in the^ clock gating logig, as discussed with 
reference Co Fig 6C. U22E- 10 and U22E-I2 l.Stch J signals^ CFS and CLS 
respectively. U22E-15, U22E-2, an^i U22E-7 provide 1-cJ.ock delay, 2-clock 
delays, and 3 -clock delays respectively for the CLSR1 signal. 
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Gated clock operations will now be discussed with reference to Fig 6C. 
Gated clock signal^ U12A-8 and U12A-6 e^ch g^te early clock CPE-bar with DOA6 
from U21E-6 ff<? that address . generation >ill only be performed when the 
ryn/ load -bar signal DOA6 is high, indicative ;of ruft operations. Gated. clogk 
signals U12A-8 and U12A-6 $ls.o gate early clock CPE-barf with U13A-?, which q.s 
composed of 3-g^ting conditions; .U17A-8, U17A-11, an,d U22A-4; discussed in 
greater detail ftitt} reference to ?ig 6D. feated^ clock signal U12A-8 also gates 
early clock CPE with U14A-6, whicn enabj.es high clock rate memory scanout 
operations within a block. Gated clock signal U12A-6 also., gates early clgck 
CPE-bar with U21B-2, which enables low clock ra.te memory block re- addressing 
operations. Consequently, w hen memory operations are proceeding within a 
block of 64 -pixels"" tne ^ address generator clocJc is generated as shorter 



biopjc or b4-pixeis. t^ e' address generacor ciqck is generauea as — s^wEe*' 
period ciocjc"_ sig nal Q12A-8" and/ wHen are making — a 

transition Between need additional criocTc time tor re -aggressing. 

th| A address ; generator clocic is generated a period ciocK signal 

^termination of whether memory scanout or re -addressing^ is , being 

performed tor ^ the particular fletemipeQ by , detect iag-_afl 

Svertiow of an ad&ress/aeneraYor as" indicative , ox re -aggre ssi ng, or 
d etecting ~ot a ngn - over t low "of all address /generators , as indicative of 
canout . "Overt row tor thi s "condition is detine^ as T an overt 1 ow tor a positive 
.eIta"condit"ion 1 and an underflow tor a negative delta condition . TheretoreT 
etection ot "a carry condition tor ~a positive delta or detection ot 5 



detection ot carry condition for a positive delta or detection ot a 
non-carry condition tor a" negative delta represents an overflow condition tor 
gating a clock. An overtlow 
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condition on either the X-address generator or the Y- address generator 
causes a re -addressing condition. . „ . . . , , T ^ w 

As shown m Fig 6C, a re-^ddressing condition is detected with NAND-gate 
U13A-6 from any one or combination of the 4 -conditions .U16A-3, U17A-3. 
U16A-6, and U17A-6. U16A-3 compares the inverted oyerflgw bit Cl-bar U15E-9 
of the Y-address generator with the $on- inverted sign. bit SN1 U14E-6 of the 
Y- delta register "to detect a Y-negative overflow condition. U17A-3 compares 
the overflow bit CI U15E-9 of the Y-address generator with the. inverted sign 
bit SNl U14E-6 of the Y-delta register to detect, a Y-positive overflow 
condition. U16A-6 compares the inverted oyerflQw bit C2-6ar U15D-9 of the 
X-acJdress generator with the nor;- inverted sign bit $N2 U14D-6 of the X-delta 
register to detect an X-negative overflow condition. U17£-6 compares the 
overflow bit C2 U15D-9 of the X-address generator wa,tl} the inverted* sign, bit 
SN2 U14D-6 of .the X-delta register to detect a X-posj.tive overflow condition. 
An overflow signal U13A-6 is latched and delayed with .flip-flop D23C-10 for 
enabling of t;n$ scanoyt clock U12A-8 for scanout, m the absence of an 
overflow condition. Flip-flop U23C-10 provides a one-cJ.ock period delay, so 
that $n extended re-acrdress.ing clQck period occurs in the .clock .period 
following the Qverf low condition, which is the clock period during which the 
re-addressmg[ is performed. Latched overflow signal U23C-10 is inverted with 
inverter U14A to form a non-overflow signal U14A-6 and used to enable the 
scanout clock U12A-8. 
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Latched overflow signal U23C-10 is £lso processed with flip-flops U21B-5 
and U21B-2 to provide a triple clock period for an overflow. These flip-flops 
are clocked with the non-gated delayed clock puj.se CPD U20E-3 to control 
non-gated clock period time delays, if clocked with the gated clock pylse, 
such as with U15A-8; then the gating clock logic could cause the clock signal 
to lock-up. 

A triple clock period for re-addressing will , npw be discussed with 




single .clock period; yiel.ding a triple clock oeriocf to facilitate re- 
addressing. At the completion ,of the third clopk period, the 1- set signal 
U21B-2 enables a single clock signal U12A-6 and is inverted to a 0-set signal 
U21E-8 to reset U21B-5 through U20E-11 and to reset U21B-2 through U15A-1I on 
the next clock to clock . flip-flops U21B-5 and U21B-2, respectively. This 
triple clock period logic is designed to operate for a single overflow 
condition surrounded fly non- overt low conditions, or tor t wo overtlow 
conditions immediately tdii owing e acn otne r. and to r many overt igw condiE ions 
immediately following each other. For a single overtlow condit ion- scanout 
clock U12A-B has a series ot si ngle period ~cloclcs and Has \-r. Lock periods 
missing tnat are coincident with overtlo w conditions and re-addressing clock 
U12A- b TaB a" single ciocjc coincident wiffi tne overtl ow condi trio^. For 
multiple sequential "overflow cond itions.- scanout clock U1 2A-8 has a series ot 



single period cl onks with a series of triple clock 
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overflow 
ocJcs each 



periods missing that a r e c o i ncident w i t h the nwl t i ple sequential 
conditio^ ^ muitipift sequ ential cl 

separ ata g^^m .g and ^ bp ^-addr essin g clock U12 A - 6 are 
genera^ separp purposes. They are UKea together with gate 

D21D-8 for loading the butter memory with signal C3-22 and for clocking 



register U23C-9. This cause 
buffer memory to. be clocke 




period propagation delay, tiffie for the .memory. The aesign, is carefully 

configure d so that the pipeline propagation del a v~isff renter than the QTTT 
clocR a per iods and less y Efian th<? 1 . $ J clocK. periods, to" I acil itate P^PPer 
r.Tnrkiifa oF the memory output signal' into* the Durrer memory ygcn a 



clocking or tine memory output signal lnra^Efte — putter memory vacft — a 
pro pagati on cielay tnaF'c'an approach the 1.5 r.locK period. . ~^ 

The clock signals to the .address "generation registers are implemented as 



lite, v^j-v^jv <-v^ , auuicoo aq'CJ-ai.iuii J- <— 3 ""^^ ii -| . 

the logical-OR of a plurality of different clock signals. In order to 
equalize clock delays so tt\at each clock is twice delayed, including the once 
inverted CPE-bar siqnal with U12A-8 and U12A-6, the two address generator 
clocks U12A-8 and U12A-6 are separately ORed together with each of the 
address generator clock gates U9A-6, .U9A-8 , UlOA-,6, and U10A-8 (Fig 6B) 
rather than using the pre-Ored clock signal U21D-8 m order to reduce clock 
skew. 
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Clock _gating logic will now be discussed in qreater detail with ref- 
erence to Fig 6B i Afldress decoders U2QB and XJ19W decode the destination 
address pQcg£q_ DOC7 to" generate a decoded address signal at tne , outputs . oT 



addre 



code logic U21D-6 to enable decoders ui?b ana U2UB wnen tne 4-msbs , 
DQC5. DOC6 "and DQC7 are'aii i-set" Tne'biocK : enable signal U21D-6 enables 
Ui9| and" U2Qb" with" trie b El- b>r~ input s""Th ^ address signal 

5oC3 enables u^OB when low, Ijgdi cated Py the E2 : -pfrtr ' g |gg r |||y ' 



5oC3 enables U2 Q B whjn low indicated Py the E2 r -pjr 

addresses and UpB generates £ ne Bsfl addresffesV one ot tne'B-addresses Tor 
the "selected, naif "is < selected with the 3 - least "signitij cant address bits dOCDT 
DQCl"and"DQC2 wM U2QB. The address 

decoder that has been Selected with " tlie DOC3 to" DOCi adaress" signa l s has one 
or 8 -"address "output I ines Tow 7 as detemined by the DOCO to DQC2 lease 



significant address bits . The low outpuj line enaMes the register clock 
gating Togig to steer T he clock to the "addressed register. The clock is the 
negative"going~s tro5e 0^2b-3 "generated under computer control. Et tectively.7 
the decoded address sign als steer the computer stfjpbe to the appropriate reg- 
ister clock inp ut to clock the computer output data word into" that register. 
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Control logic for a display cpnf igu^ation will now be .discussed with 
reference tp Fig 6D. Signal .IJ20IJ-1 is. a single pulse clock signal occurring 
at the leading edge of tne line sync signal except when a frame sync pulse or 
a computer load sigi^al is generated. This, clock pulse is generated by U18E-6, 
as previously described. Disabling pf this clock pulse during the frame sync 
pulse and the , computer load oeriod is performed by Qnng together, the 
computer load signal I?0A6-bar U2T3D-12 and tne synchronized frame Sync signal 
CFSR1 U20D-11. When either th? computer load signal DOA^-bar or the computer 
frame synp signal CFSR1 are hj_gh, NOR gate U20D-13 and inverter U1BD-2 apply 
a, high signal to U20D-2, which causes U20D-1 to bp low .independent of the 
line sync clock pulse. Only when the computer load signal is m the ryn state 
(D0A6 -"bar is low) and the frame sync signal CSFRL is low can the line sync 
clock U20D T 1 go high to generate. a clock pulse. 

The line sync clock U?0D-l.is generated from the line sync signal QhS . 
The CLS signal is latched m flip- flop U22E-12 to generate a resyiichronized 
line sync signal CLSR1. The resynchronized line sync signal CLSR1 is delayed 
one clock period by latching in flip-flop U22E-15 to generate a delayed 
re synchronized line sync signal CLSR2*. rJAlS(D-gate. U1BE-6 generates a one clock 
perigd negative pulse when the resynchronized line syng signal CLSR1 U22E-J2 
is high and yrtie^i the delayed resynchronized lir^e sync signal CLSR2 U?2E-15 is 
still low, indicative of the first clock period of the resynchrpnized line 
sync signal. Inyerter. U21E-10 inverts the delayed line sync signal CLSR2 
U22E-15 for NANDmg with the non- . 
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delayed line sync signal CFSR1 U22E.-12 for generation of the pne clock period 
signal U18E-6. Therefore, U20D-1 is ^ one clock period ppsitq-ve pulse that 
occurs at the leading edge of each line syjic pulse that is disabled l?y the 
computer being m the load mode or that is disabled by the frame .sync pignal . 
This clock U20D-1 is used .tp clock the R-registers for updating witn the 
delta parameter at the positive edge and to transfer the updatecT number in 



the R-registers to the R-registers at the negative edge. . 

The J computer strob e DQA7 is generated under software control It is a 
s^iort positive pulse ; in wiath"" It is NANDed 

with the computer run signal D0A6 using inverter U18D-6 and NAND- gate U22B-3 
to qenerate a short negative pulse when enabled by the DQA6 run/load-bar 
signal being low, as indicative of ^ load command. The negative pulse.U229-3 
is used to clock the register that is addressed with the computer destination 
address signal with decoders U19B and U20B to load data from the computer 
into that selected register. 
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Address generator, clock; g.ating logic will now be discussed with 
reference to Fig .6B. T^is logig is composed of qates U19C 4 U19D, U18C, UBA, 
U9A, ancj U10A. This logic comprises 4 -channels of* clopk logic for the address 




_ -register gating logic will now be discussed with reference to fig 
Gate U19C-1 steers the load strobe U22B-3 to clock the register \?itn the 
computer generated strQbe tQ load the computer generated parameter into the 
related register. Steering signal U19C-3 steers the computer pulse U19C-2.to 
the input of gate U18C-1. Gate U18C-3 combme.s the two mutually exclusive 
clock signals, the computer strobe and the line sync strobe to clock the 
XR- register CX^RM with signal U18C-3 for the computer Strobe and on the rising 
edge of the line sync pulse. , „ 

Gate U19C-10 steers the load strobe U22B-3 to clock the register with 
the computer generated strQbe tp load the computer generated parameter into 
the related register. Steering signal U19C-9 s.tTeers tne computer pulse U19C-8 
to the input of gate U18C-9. Gate U18C-8 combings the two mutually exclusive 
clock signals, the computer strobe and the line sync strobe to clock the 
XR-register CXRL with signal U18C-8 for the computer strobe and on the rising 
edge of the line sync pulse. n . . , 

Gate U19D-1 steers the load strobe U22B-3 to clock the register with the 
computer generated strobe to load the computer generated parameter into the 
related register. Steering signal U19D-3 steers the computer pulse U19D-2 to 
the input of gate 
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U18C-4 Gate U18C-6 combines the two mutually exclusive clock signals, the 
computer strobe and the line sync strobe to clock; the YR- register CYRM with 
signal U18C-6 for the computer strobe and on the rising edge of the line sync 
pulse. 

Gate U19D-13 steers the load strobe U22B-3 to clock the register with 
the computer generated strobe to lpad the computer generated parameter into 
the related register. Steering signal U19D-12 steer$ the computer pulse 
U19D-H to the input of gate UlffC-12. Gate U1SC-11 combines the two mutually 
exclusive clock Signals, tlje computer strobe and the line sync strobe to 
clock the YR-register CYR^ with signal U1BC-11 for the computer strobe and on 
the rising edge of the line sync pulse. , . , 

P-register clock logic will now be discusse.d with reference to Fig 6B. 

The XP-register clock signal U9A-6 to XP-reqister CXPM is generated, from 
the inverted X.R-register clock signal CXRM U8a- 2, the gatea write signal 
T.J18E-I1, the re -addressing c^ock U12A- 8, and the scanout glock U12A-6. The 
inverted R-register clock signal U8A r 2 causes the XP-register CXRJVI to be 
clocked with tne computer strobe and with the trailing edge of the line sync 
signal, the inverted clock signal fi^om U1BC-3. The gated write signal U18E-11 
Clocks the XP-registers for each write strobe U22C-11 that loads a parameter 
into memory in order to advance the address generators to the next address. 
The gated re-addressing clock signal U12A-£> and the gated scanout signal 
U12A-8 have been discussed above with reference to Fig 6C. 
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The XP-register clock signal IJ9A-8 to XP-register CXPL is qenejrated , f rom 
the inverted XR-register clock signal CXRL UBA-4, the gatecr write signal 
TJ18E-11, the re-addressing clock U12A-8, and the scanout qlock U12A-6. The 
inverted R-register clock signal U8A r 4 causes the XP-register CXRL to be 
clocked with tne computer strobe and with the trailing edge of the line sync 
signal, the inverted clock signal firom U18C-8. The gated write signal U1BE-11 
Clocks the XP.-registers for each write strobe U22C-11 that loads a parameter 
into memory in order to advance the address generators to the next address. 
The gated re-addressing clock signal U12A-b and the gated scanout signal 
U12A-8 have beep, discussed abpve with reference to Fig 6C. 

The .YP-register clpck signal U10A-6 to YP-regisxer CYPM, is. generated 
from the inverted YR-register clock signal CYRM U8A-6, the gated write signal 
yiBE-11, the re-addressing cl,ock U12A-8, and the scanout c^ock U12A-6. The 
inverted YR- register clock signal UB^-6 causes the YP- register CYI^M to be 
clocked with the computer strobe and with the trailing edge of the line sync 
signal, the inverted clock signal firom U18C-6. The gated write signal UlBErll 
plocks the YP-registers for each write strobe U22C-11 that loads a parameter 
into memory in order to advance the address generators to the next address . 
The gated re- addressing clock sig$al U12A-b and the, gated scanout signal 
U12A- 8 have been discussed a£>ove with reference to Fig 6C. 

The YP-register clock signal U10A-8 to YP-register CYPL is generated 



from the inverted YR-register clock signal CYRL U8A-8, the gated write signal 
TJ18E-11, the re -addressing clock U12A-8, and the scanout clock U12A-6. The 
inverted YR-register cIock 
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signal U8A-§ causes the . YP- register CYRI.. to be clocked with, the computer 
strobe and with the trailing edge Qf thq line sync signal, the inverted , clock 
siqnal from U18C-11. The crated write signal UI8E-11 clocks the Yp-registers 
for each write strobe U22C^11 that loads a parameter into memory m order, to 
advance the address generators to the next address. The gated re- addressing 
clock signal U12A-6 and the gated scanout signal U12A-8 nave been discussed 
above with reference to Fig SC. 
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Gates U22C-11, U18D-12, and U18E-11 provide a write strobe to .clock the 
address registers to advance the address iji the address registers in 
accordance with the delta parameters .loaded .in the delta .registers . This 
write clock clocking of the address registers is used for writing a sequence 
of words into memory without the need to reload the. address^ registers , where 
the address registers $re incremented with tt;e write strobe to, advance the 
address from .tfhe initially loaded address in accordance with the delta 
parameters. This write strode is gated with the D0A5 signal with gate UIBE-11 
to enable advancing the address generators, during the load mode and to 
disable advancing tne address generators during the run mode. 
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Address Generators 



Two address generato.r cqnf igurations are shown in Figs 6C) to 6R. The 
address generator^ shown m Fiasco to 6R provide for o verflow detect W -Eg 
gate a cioclc in accordance witn the arrangement shown in Fig 6C. The address 
generator s shown m Figs 60 to 6R do nqt provide for such overflow detection. 
in this configuration, overflow detection is enhanced by arranging , the adder 
logic so tnat trie overt low trom "an adder " c5ip coincraes witm tne desired 
nosition of overt low detection . in order to provide this teature, an extra 



_np is us eg in the address generators of Figs 60 and 6P. The address 

generators shown m Figs 6Q and 6JC do not have such overflow detection and 
consequently can be lmiSlementecJ with one less adder .chip. , 

The XP-address generator will now be discussed with reference to Fig 60. 
Register U8D, U9D, and U5D store th$ address parameter. Register U17D ana U7D 
store the delta parameter for updating the address parameter. Adders, U13D to 
U16D and U6D add the delta parameter to the address parameter to obtain-.an 
updated address parameter. Multiplexers U10D to U12T) provide for loading 
initial ccpnditions into the address , register during tlie loacj mode and provide 
for updating the address parameter m tlie address register m response to the 
delta parameter m the delta register ^n t£e run mod?. n n 

The delta parameter initial condition is loaded into the delta register 
from the computer output port. The 6-LSps from the computer output byte are 
applied to the D-inputs of delta register. U17D and U7D/ The CXPS clock 
provides a clock pulse at the appropriate time, as described with reference 
to Fig 6B, to * 
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clock the initial conditions into, the delta, registers . n . 

The address parameter initial condition is loaded into the address 



byte are applied to the D-mputs of address register U8D, U9I?, and t U5D. The 
CXPM and UXPL clocks provide clock pulses a"t .tl^e . appropriate ti.mes, as 
described wa,th reference to Fig 6B, to clock the initial conditions into the 
address register 

In the run mode, the address register is clocked with the CXPM and CXPL 
clocks to update the address parameter m response to the delta parameter. 
The output of the address reqi.ster; the Q-outpyts ,of the UBD, U9D, and USD 
register; are applied to th? a- inputs of adder circuits U13D to U16D an<J U6D. 
The output of the. delta register; the Q-ou.tputp of the U17D and U7D register; 
are applied to the ^-inputs of adder cipcuitp U13.D to U1£D and U6D. The 
output of the adder circuits c?n the summation, lines is the binary sum pf the 
A-mputs from the address register and the B T inputs from the delta register, 

?rovidmg an updated address parameter that is input to the address register 
hrough the multiplexers to the D- inputs of the address register. 
Consequently, each time the address register is clocked, the updated address 
is loaded into the address register and the updated address that is lpaded 
into the address register is output on the Q-lines from the address register 
to again be added to the delta parameter with the adders to provide the next 
updated address to the address register. 
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The multipl exers U10D. U11D . and U12D multiplex the updated addres 
teter tronT'tne aade rs into tne address register to ioart_ the_ imtia 



parameter tronT the adde rs into tne address register :o load tne initial 
conditions into tne addre ss register at the beginning ot :ne load m ode andTo 
load the updated address parameter from the adders tnereatter. Tne els signal 



from U15A-3, as described with reference 
to load initial conditions at the st;" L 

updating QEjtfte address parameter wit 
adders are connected witn tne 



from 




^ at in ?ne YP-ad^r^ss generator will now be discussed with reference to Fig 6P. 
Register UBE, U9E, and u5E store the address parameter . Register U17E and U7E 




s register 
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during t he load mode and provide for updating the address parameter in the 
address register in response T tc r tne r ^ei^ parameter in the g^Ita register in 
the run mocLeT , 

The delta parameter initial condition is loaded into the delta register 
from the computer qutput port. The 6-LSps from the computer output byte are 
applied to the D-inpUts of delta, register U17E and U7E, Th^CYPS clock 
provides a clock pulse at t;h$ appropriate tq.me, as described with reference 
to Fig 6B, to clock the initial condition^ j_nto ,the delta registers. _ 

The address parameter initial condition is loaded, into the address 
register from the computer output port. The 6-L$Bs from the computer output 
byte are applied to the D- inputs or address register U8E, U9?, and ,U5E. The 
CYPM and UYPL clocks provide clock pulses at .thte . appropriate times, as 
described wi,th reference to Fig 6B, to clock the initial conditions into the 
address register. , 

In the run mode, the address register is clocked with the CYPM and CYPL 
clocks to update the address parameter in response to the delta parameter. 
The output of the address reqister; the Q-outputs pf the U8E, U9E, and USE 
register; are applied to the a- inputs of adder circuits U13E to U16E an<l U6E. 
The output of the delta register; the Q-outputp of the U17E and U7E register- 
are applied to the 9-inputs or adder cipcuitp U13E to U1£E and U6E . The 



output of the adder circuits on the summation lines is the binary sum of the 
A-ifiputs trom fcne'address register and :he~5- inputs rrom^tne delta register? 
providin g an updated address-parameter tnat is input to tne address register 



providing an updated address parame 
through "the 
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multiplexers to the D-mputs of the address register . • Consequently , each time 
the address register lj clo'cjcedT the updated address is loaded into THe 

Address Keg^ster Tana ^tfne uWated^ aaaresB tnac is loaded .into the address 
r egi s ter i s outp ut oh the ^p-iihes^trom the address, register tg again, Qe added 
h e ' delt a param e ter wi th the adders to provide the~ne*;t updated address to 



t o' the delt a param e ter wi th the adders to provide the' next updated address to 
the address register. 

The mu 1 1 ipl exe r s U10E, . U11E. and U12E multiplex the updated address 
parameter from the adders mt;o the address register to load the initial 
conditions into the address register at the beginning of the load mode and to 
load the updated address parameter from the adders thereafter. The ELS. signal 
from U15A- .3,. as described with reference to Fig t 6D, controls the multiplexer 
to load initial conditions at the startups aline sync pulse and^to enable 
updating pt the address parameter with the delta parameter thereafter . ~^ 

The adders are connected with the carry output trom the preceding stage 
connected to the carry input of the next subsequent stage for a rapid carry 

?ropagatmg through the .adder. The adders are arranged so that tfre overflow 
rom TJ15E-? coincides with the point that divides the scanout bits ancj the 
re-addressing bits, where the .scanout bits are the th,ree. ^ess significant 
bits and the re-addrepsipg bits are the six more significant bits. The 
overflow signal U15E-9 is input to U16A-2 and U17A-2 (Fig 6C) for controlling 
gating of the clock. 

The XR-address generator will now be discussed with reference to Fig 60. 
Register U8B, U9B, and USB store the address parameter. Register U17B ana U7B 
store the delta 
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parameter for updating the address parameter . . Adders U13B to U15B and U6B add 
the delta parameter to the address parameter to obtain an updated address 
parameter . Multiplexers U10B to IT12B provide for loading initial conditions 
into the address' register guring the loa d mode and provige tor upaating the 
address parameter in" tne address 'register in resp onse to tne delta param eter 
in tne delta register m tne run mode. * ~ * . ™ ~ 

The delta parameter initial condition is loaded into the delta register 
from the computrer output port. The 6-LSBs from the computer output byte are 
applied to the D-mputs of delta register U17B and U7B. The CXRS clock 



register from the Computer . output port. The 6-L$Bs from the computer output 
byte are applied to the D-iirouts of address register U8B, and U5B. The 

CXRM and tXRL clocks provide clock pulses at .t^e . appropriate ti.mes, as 
described wi,th reference to Fig 6B, to tilock the initial conditions into the 

sSdir^ss i*ecrister 

In the run mode, the address register is clocked with the CXRM and CXRL 
clocks to update the address parameter in response to the delta parameter 
The output of the. address reqi.ster; the Q-outputs of the U8B U9B, and U5B 
register; are applied to the? K- inputs of adder 6ircuitS T U13B to U15B and U6B. 
The output of thh deltja register ;^the Q-outputs of the U17B and U7B register; 
are applied to the B- inputs of adder circuits U13B to U15B and 
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U6B. The output of the adder circuits Qn the summation lines is the binary 
sum of the A- inputs from the address register and the inputs from i the delta 
reqister, providing an updated address parameter that is input to the address 
reqister through the multiplexers to t.he D-i.nputs of the address register. 
Consequently, each time the address register id^ clocked, the updated address 
is loaded into the ^ddresp register and the updated address that is loaded 
into the address register is output on the . Q- lilies from the address register 
to again be added to the delta p&ratpeter with the adders to provide the next 
updated addres.s to the address register. , ^ 

The multiplexers U10B, . U11B. and U12B multiplex the. updated address 
parameter frottf the adders into, the address register to load the initial 
conditions into the address register during the load mode and to load the 
updated address parameter from "the adders during the run mode. The D0A6-bar 
signal from U18D-6, a,s .described^ .with reference to Fig 6B, controls the 
multiplexer to load initial conditions m the load mode, and to enable 
updating of the address parameter with the delta parameter m the run mode. 

The adders are connected with the carry output from the preceding stage 
connected to the carry input of the next subsequent stage for a rapid carry 
propagating through the adder. , ,. ^.^^ _ 

The YR-address generator will now be discussed with reference to Fig 6R. 
Reqister U8C, U9C, afid U5C store the address parameter. Register U17C ana U7C 
store the delta parameter for updating the address parameter. Adders U13C to 
U15C and U6C add the delta parameter to the address parameter to 
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obtain an updated address parameter. Multiplexers U10C. to U12C provide for 
loading initial conditions into the address register during the load mode and 
provide for updating the address parameter m the .address register m 
response to the delta parameter m toe. delta register in the run mode., 

The delta parameter initial condition is loaded into the delta register 
from the computer output port. The 6-LSps from the computer output byte are 
applied to the D-inputs of delta register U17C and U7C. Thp CYRS clock 
provides a clock pulse at the appropriate time, as described \yith reference 
to Fig 6B, to clock the initial qonaitionp j.nto .the delta registers. _ 

The address parameter initial condition is loaded into the address 
reqister from the computer . output port. The 6-L$Bs from the computer output 
byEe are applied to tne D-inputs of address register U8C, U9C/ and U5C. The 
CYRM and UYRL clocks provide clock pulses at .tl^e . appropriate times, as 
described with reference to Fig 6B, to clock the initial conditions into the 
address register. 

In the run mode, the address register is clocked with the CYRM and CYRL 
clocks to update the address parameter m response to the delta parameter. 
The output of the address register; the Q- outputs .of the UBC, U9C, and U5C 
register; are applied to the AT-mputs of adder circuits U13C to U15C and U6C. 
The output of the delta , register ; the Q-ou.tputp of the U17C and U7C register; 
are applied to the ?- inputs of adder cifcuitp U13.C to U1$C and U6t. The 
output of the adder circuits on the summation lines is the binary sum of the 
A- inputs from the address register and the 
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B-inputs from the delta register, providing an updated address parameter that 
is input to the address register tnrough tne multiplexers to the D-inputs Qf 
the , address register, c on seq ue ntly., each, time the address, register is 
clocked, the up dated address js.loa^ address register and the 

iL addre ss th a t i s iQaaea im;p the .address, register is' output on the 



update d addre ss th a t i s loaded^, into the .address^, register is, 'output on Log 
O-I i n e s xxom t h e addre s s ^^^xstex tQ ag^^ 1^% addea to .the, delta" parameter 
with gae adders to updated, address to the aaares.s register! 

£he. muAtipi^ address 
parameter trgnf tne aadeys ^tQ , me afldygss L yeg^ter to. load ae , initial 
conditio ns "into the address register during the load mode and m to load the 
updated afl^ adders diiring tne run mode . Tne DUAb - .bar 



da t e d " addr e as „ p a r . ame t e r~£ r om 
gn^l from U18D-6, a^s describe 
Itiplexer to load initial coi 



sic __ _ 

multiplexer to load in itial conditions in the load mode and to enahTp 

updating ot the address parameter With the delta parameter m the run mode. 

The adders are connected with the carry output trom tne preceding stage 
connected to the carry input of the next subsequent stage for a rapid carry 



propagating through the adder. ^ - j • ^ • * 

F * Output of the address signals will now be discuss.ed 1 with reference to 
Fig? 6 0 and 6P. The Q-outputs of the XP-address, register and YP-address 
register are routed co the memory for accessing and for loading of 
Information. The address connections between the memory and the address 
generators are listed in the CABLE CONNECTION TABLE here under the heading 
CABLE- I BM1,2/BL1 (CI). The Y-address bits YO to YB and the X- 
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address bits XO to XB, including the complemented and uncomplemented X3 
memory board address select, bit, are listed, therein .together with source 
circuits on the control logic board and destination circuits on the memory 

boards^ mode, the XP-address register and YP-address^ register ape 

continually clocked with the gated clock, , as. discussed with reference to Fig 
6B; resulting in the add ress parameters being co ntinually updated with . the 




eta. The 
in order tq 



buffer, as discussed with referenceto Fig 6D herein. 
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MEMORY BOARDS JJt ^ ^ . . _ _ . 

A detailed design of one configuration <?f the memory of the present 
inventipn is shown in Figs. 6E to 6N. TJie ^rchiteqture of qne of the memory 
boards is shown m block diagram form m Fig 6E, 15 shown \n detailed block 
diagram form in Figs 6F to 6i t/ and is shown in detailed logical diagram form 
In Tiqs 6K to 6N7 Commonality of symbols and features in these diagrams 

Srovide for cross referencing to .different levels of .detail between Ehese 
lagrams. This memory uses Mitsubishi M58725P RAffls having 16,384 (16K) lpits 

j - 0 ^ " n ' 0 Tr x J ~ "° -~ ner word configuration. 

Each TRAM chip 
.a chip select 

v i , „ ^ ^ .me W-b^r. The 

address lines address 1-word out of 2K;-words stored m the memory chip. The 
data lines output the addressed word ^n the read. mode ancj input a word fpr 
storage m the write mode. The data lines are tristate lines tfrat, when in 
the read mode, output the addressed inf oration when enabled with th,e chip 
select line S-bar and, when in the write mode, store the . data .m the 
addressed location. The output enable signal G-Joar controls inputting and 
outputtmg of data frqm the ^AM. When disabled with the chip select line or 
the output enable line, the data lines are m the floating tristate 
condition . 

The memory control logic is comprised pf cirguits,U19A to U19E, as shown 
in Fig 6F, Buffers U19A and U19D are non-inverting buffers that buffer the 
address signals for fanout to the RAMS. In this configuration, 11-address 
signals YAJB to YA8B and XA4B 
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to XA8B are fanned out to the address inputs AO .to AIO of the RAMS . Decoders 
U19B, U19C, and U19E decode the scanout portion of the address word for 
control of the. tristate data lines of the RAMS. Degoder U19B decodes the 
Y- scanout portion YAO to YA2 of the scanout portion of the Y-address. 
Decoders U19C and U19E decode the X- scanout. portion XAO to XA2 of .the 
X-scanout portion of the address. Deqoder U19C j.s enabled for read operations 
and decoder U19E is. enabled for write operation^. Each of decoders; U19B, 
U19C, and U19E; receive 3 -input scanout addres.s lines and generate 8 -decoded 
scanout control lines m response to the decoding. Decoded signals MYO-bar to 
MY7-bar froir\ U19B generate Y-control signals to select one column of 8-RAMs 
with the chip select pm S-bar t Decoded signals MXOR-bar to MX7R-bar from 
U19C generate X- control signals m the read Tpode to select one row of S-RAMs 
with the output enable p^n G-bap. Decode.d signals MXOW-bar to MX7W-bar from 
U19E generate X- control signals m the write mode to select one row of 8-RAMs 
w^th the output enable, pin G-bar . Therefore, selection of a cglwro of ,8-RAMs 
with the , Y-scanout signals and ^serection pr"a ipw L ot a-ms . ^tn 



The decoders have gating signals El -bar" E2 -bar. and E3 . Signals El-bar 
and E2-par are permanently enabled on decoders U19B and U19C w^th a ground 
connection and> signal E3 is permanently .enabled on decoder U19E with a pullup 
connection. Signal E3 pn decoder U19BT is used to place the RAMs on the non- 
selected memory board m the standby mode for reduced power 



330 



consumption. This is achieved by disabling. U19B on the non- selected board 
and enabling U19B on the sel ec red .board vfith tne XA3 and XA3-bar signals, 
which select the board to be utilized. Disabling U19B on tlie non-sexectea 
board disables the Y- scanout signal? to the chip jselect Din S-bar, which in 
turn places tne non- selected RAMs into tne, standby mode fQr reduced power 
consumption. The XA3 and X&3-bar aating of the U19B decoder is not necessary 
for memory operation. bu.t .is used for reduction of power consumption .. Pin E3 
on decoder ul9C and pm E2-bar on decoder U19E are controlled with the 



DIEN-bar siqnal which is derived from the computer run/load mode signal for 
blind decoder U19C in the run mode to jre^d from memory, to disable 
ler JJ1SE .in . the , run mode .to prevent _ writing in tg jnempjfry^^to d e £ a g|| 

>a e ")fe3 fn 




^rqanizea m ^-logical columns ana construcuea on uiie xuw a meiuuiy vudiu, 
where each memory poar^ J h^s^^ -groups ^pr ^16 -R^Ms_, ea^h^s^own^in^one^of ^Figs^6G 




to 

and~Figs 6K "tcf 6N" ancf by 
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All RAMs are addressed by the game 11-address, lines; shown as the 
address bus to the A- input of each RAM in Figs 6G to 61 and shown in greater- 
detail as the address bus to tfie AO to A10 inputs of RAMs UB and U16 for each 
pair of logical columns m Figs 6K to 6N. The addresses are placed on the 
Sddress bu^ by U19A ancf U19D (?ig 6F) ajid are routed to all 16^ RAMs on each 
of the RAM groups (Figs 6G to 61) to excite the RAM address inputs A (Figs 6G 
to 6 J) and 7^0 ,to A10^(Figs 6K to 6^J) . n ^ ^ , n _ _ . _ 

Each logical column of RAiyis is selected by a single one of the eight 
Y-scanout signals f jrom U19B (Fa,g 6F) , shown cpfmected to ,the S-bar pin Qf 
each RAM in the logical column in Figs 6G to 61 and. shown in. greater detail 
to the S-bar inputs of RAMs U8 and U16 for each pair of logical columns m 
Ficrs 6K to 6N 

Each logical row of RAMs is selected by a single one of the eight 
X-scanout signals; MXOR .to MX7R in the read Tftqde to the^ output enable Din 
G-bar and MXOW to MX7W in the write mode to the W-bar from U19C and U1?E 
respectively (Fig t 6F) . Each of these signals are shown connected . to the pair 
of RAM in the ldgical row for each pair of logical columns m Figs 6G tp 6 J 
and shown m greater detail for RAMs UB and U16 for each pair of logical 
columns in Figs 6K to 6N. Each of these X-pcanout signals, enable the same 
pair of RAMs in each of the 4-pairs of logical columns (Figs 6G to 6J and 
Figs 6K to 6N) . ... 

All RAMs in the pair of columns shown iji each of Figs 6G to 61 abd Figs 
6K to 6N have the corresponding data bys p;ms collected together £ shown as 
the cjata bus to the D- input of each RAM in Figs 6G to 6 J and shown m greater 
detail as the data bus 
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to the DO to D7 pins of RAMs U8 and U16 for each pair of logical columns in 
Figs 6K to 6N. The data bup and control signals are connected to a pair Qf 
Intel 8216 bus interface chips for each pair Qf logical . colymns, as shown m 
simplified form in Figs 6G to 6i. and m aet.atilQd form m .Figs 6K to 6N. The 
operation of the data bus interface is discussed m greater detail 
hereinafter. 

In view of the above, all RAMs are addressed with the same address 

signals ang one RA^"tnat "^s at the intersection, Qt, the enabled x-yov. scayout 
signal] a na trie enabled" Y-co^upm sganou^ "alone is permitted, to place 

tne"addire , s g ed wor a on .tfte data bus in the .react mode and alone is written inta 
at "t he addre s se d location trom the data SuF 
" in tag read mode, one ram is ena&AecQ 



ac cne aaaresseq location iron pne gang, pns. 

" In the read mode7 oae ram is i enaftiedTto output, the u addressed word onto 
the system d^a'^s. ThiJs c^ T5e~ Imp^ 

corresponding r B"d at f lines tr , om eacn RM However . busing together a large 
number o£ "RAM datgi : Iineg7_7sucJi as t 12 8 -R AM data lines in t^His configu ration. 

isolate 



number" o£ RAM data lines sucn as 128-RAM data lines in tHis conf lguratio 
can result in "reduced r am speed, sucn as due to bus and chip capacitanc 
TEeretorer Intel 8216 bidi'^ecYiqnal bus drivers "are provided' tfq "isoia 




system data bus "mtertace will now be described with reference to 

Figs 6K to 6N. Fig 6£ shows the data bus interface for row-A on each of the 
two memory boards. Fig §L shows the data bus interface for row T B on each of 
the two memory boards. Fig 6IV| shows the data bus interface for row-C on each 
of the two memory boards . Fig 6N shows the data bus interface for row-D on 
each. of the two memory boards. 
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For tl}is configuration 16 -RAMs. ape bused together through each system 
data bus interface circuit, comprising two Intel 8216 components. The 
bidirectional signals DBO, pBl, DB2, ana DB3 are connected to the RAM data 
bus and the unidirectional signals D];o and D.00, DI1 and D01, DI2 and I?02, and 
DI3 and D03 are connected to t^ie unidirectional system bus , f c?r reading from 
RAM through the DQO to DQ3 unidirectional outputs and for writing into RAM on 
the DIO to D13 unidirectional inputs. A pair of Intel 8216 4-bit bus drivers 
are used to control the 8-data bus line? for the RAM data bus. 

The Intel 8216s are controlled with, the board select signal XA3 or 
XA3-b^r and the scanout addresp select signals for the 2 -columns of RAMs 
associated with the Intel 8216 circuits. The Doard select signal, XA3-bar for 
memory board.- 1 and XA3 for memory board-2, control all of tne Intel 821§s on 
the board. Therefore, the Intel 8216s on the enabled board are partially 



enabled to connect the RAM data buses on that bpard to the system bus and the 
Intel 8216 on the disabled board are fully disabled to disconnect the RAM 
datbuses on that board from the system bus . Similarly, the column, select 
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where the column select si g nals are in com plement logxc form an d cpnjjeguentlv 
a WAND gate can p srTnm 7n 6R rurtct ionT^and Tare fcnen ANtied with tne boarS 
select: si gnal T^A^or icA3-bar m a second NAJ^D gate in noi 
rprm"£o generate the control signal - 



:orm to generate the control signal l 
.Kg ' intei S2ll chip select . TA6 inEel _8 2 r5_cirqui 
)IEN-JDar control, which, if ' 



s 



, — ^n-comp 

n complement logic torm as 
l 8^i^> circuits" are steere 



ement 



7 ogic 



neeqgfl Egr 
d witn tne 



_ ^ , , _s connected to the DIEN signal generated with U21E-6 

'Fig 6B) . Therefore, in the run mode; the DIEN signal controls the Intel 
$2 IBs to connect the RAM data bus through the D00 to P03 buffers to output 
the RAM signals onto the system output data bus and, in the load mode; the 
DIEN signal controls the Intel 821£s to. connect the RAM data bus through the 
DIO to DI3 buffers to input the write signals from the system data bus to the 
RAMS. 

Row A on the board has 2-logical columns of RAMs (Figs 6G and 6K), 
comprising the first column with RAMs U1A to U8A and the second column with 
RAMs U9A to U16A. £s shown in greater detail with reference to Figs 6K t<? 6N; 
the first column is selected with the MYO-bar column select scanc?ut signal 
and the second column is selected with the MYl-bar column select signal. The 
2-column select signal? are ORed together with U18E-3 and are ANDed with the 
board select signal with U18E-6 to enable U17A and U18A, ^ rr 

Row B on tne board hap 2-logical columns of RAMs (Figs 6H and 6L) . com- 
prising the third column with RAMs U1B to U8B and the fourth, column with RAMs 
U9B to U16B. Ap shown m areater detail with reference to Figs 6K tp 6N; the 
third column is selectea with t,he MY2-bar column select scanout signal and 
the fourth column is selected with the MY3-bar column select signal. The 2- 
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column select signals are ORed together with U18E-8 and are ANDed with the 
board select signal with U1BE-11 to enable U17B and U18B. 

Row C on tfye board has 2-lqqical columns of RAMs (Fp_gs 61 and 6M), 
comprising the fifth colump with RAMs U1C to. U8C and the sixtft column with 
RAMs U9C to U16C. As shown m greater detail with reference to Figs 6K tQ 6N; 
the fifth column is selected with the MY4-bar column select scanQut signal 
and the sixth column is selected with the MY5-bar column select signal. The 
2-column select signals are ORed together with U17E-3 and are ANDed with the 
board select signal with U17E-6 to enable U17C and U18C. 

Row D on the board has ? -logical columns of RAMs (Figs 6 J and 6N), 
comprising the seventh column with RAMs Uipto U8D and the eignth column with 
RAMs U9D to U16D. A? shown m greater detail with reference to Figs 6K tp 6N; 
the seventh column is selected with the MY6-bar column select scanput signal 
and the eiqhth column is selected with the iyiY7-bar column select signal. The 
2-column select signal? are ORed together with U17E-8 and are ANDed with the 
board select signal with U17E-11 to enable U17D and U18D. 
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BUFFER BOARD 
General 



The^buffer hoard. As implemented with a buffer, to buffer the. putputs 
a tQlflPJ^^ 6 A? .. The 



of memory ago to apply, these — 
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4/3 Buffer implementation 

The 4/3 puffer will now be disnisR Pfi with reference to Figs 6W to 6AD 

mown controlled with counter U8A 'decoded wi ffi 



A prscssRional approach is shown cgnt-rp i i ed with counter U8A decoded with 
decoder U12B to identity which or the 4 -precess ionai conditions exists Tor 
each line -butter (Fig 6W7 . This d ecoded, nu mber co ntrols which ot the 4-l ines 



input 



Line-butter (Fig km This decoded nifmhar controls which ot the 4-lin 
tter memory are selected ror each nf r.ne 4 -operational positions: t 
line butter, the output une-bn tter r.nan nsl-l. the output line-butt 



MS. 




t . The selection logic is" snown m — — 

«« WJ .wx«-*«*JT TABLE, where the input processional counter st.ates are shown 
decoded into the decoded .states and shown further decoded into t;he single 
input line-buffer select signal, the 3 -output line-buffer select signal, and 
tire output weight select signal. 
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Table from specification omitted herein 
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The 4/3rds buffer is shown implemented with two address qounters, an 




the image processor. The, output address counter ccpntrols thre$ line- putter! 
outputtintfto the spatial . Tilter . Address multiplexing logic consists oi 
multiplexers that select either the input counter or the output counter for 
the address input of each line-buffer RAM in accordance wj-th the mpyt 
columns in the TBUFFgR MEMORY MULTIPLEXER ASSIGNMENT TABLE. S^larly L tfUS 
logic selects the write mode for the line buffer , being loaded and selects th e 
r^d mode ytor ^ . 77 . ~ " " 

Similar to the address selection discussed above, the input and output 
siqnals to the RAM line-buffer being .loaded and frptn the RAM line-buffer 
beinq unloaded are shown implemented with input multiplexers U4F, U5F, U6F. 
U8F , U9F, U10F, U12F, UI3F, U14F, U16Ff^ U17F, and U18F and output 



2 



enerates output data to ttre post -processor for exciting the display. The 
.ut puF ck nnel ot eacn ot the Tine^tter/ is i cbnTylieo: tor outpptfcing to 
■acn ot the 3 -output chan nels under control or tne precessionai decoder 
ignais. E ach ot tfle 3 -line Putters selected tor 



SSH r 

signal 
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output ting are selected for Qu^putt-jna to different, output channels ,- 

chahhil-l', channel- ^7 "and Qmm^£-^A.,,M<1QJ: control ot tfte_ precgssignal 
decoder signals "- as shown in the OUTPUT columns ot .the BUFFER . MEMORY 
MULTIPLEXED ASSIGNMENT TABLE. Similarly, the spatial filtering weight is 
selected from the channel-2 line- buffer, as shown in the WEIGHT column of 
the BUFFER MEMORY MULTIPLEXER .ASSIGNMENT TABLE. , . , , „ , 

In view of the above arid in view of the referenced schematics . and block 
diagrams, a buffer memory is provided t.hat inputs pixel information to any 
one of 4-line-buf f ers and outputs pixel information fr.om any one of 
4 -line-buffers to any. one of 3-putput channels. Alsp, sequential operation is 
proyided that sequentially applies each of the 4-line buffers to each of the 
positions of input buffer, channel -1 output buffer, channel-2 output buffer, 
and channel -3 output buffer for loading of a single lq.ne into a line-buffer 
and simultaneously for outputting o.f 3-parallel lines into a post -processor . 
. ^ The buffer tnemory iB shown imp lemented to store both weight address 
information tor weight determination and pixel intensity information. The 
pixel intensity informa tion is loaded into an interface" pipeline (kernel) 
register, such as'toiTuse with the post processor, such as a spatial 
processor . The weight r address lnfomaYion is converted to weight lntormation 
with a table lookrup m a weight-RAM. Weight address information is stored in 
the line -butter r.6 implement interpolation in the post-processor.- which 



the line- butter to implement interpolation in the post .-processor .- which, m 
one configuration may ne more efficiently impieme-nted "with weight address 
information. Alternately, the weight address - 
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the. 



^~of~weight "addre s's" intormatighjin the" bu tter" memory . J ^ 1 ° n 

A register interfac.e is provided inbet.ween the buffer memory and. the 
post -processor. The regi sters" may be considere d to be implemented m a 
pipeline form to enhance performance and to provide stable latched signals 
for the post-processor. The registers are implemented to store 9-pixels in a 



9 -pixel kernel arrangement for processing, with a. post-processor. AIsq, a 
weight RAM is providetl that stores weight information in response to weight 
address information from the buffer memory. 

The memory components are Intel 2149H RAMS. The logi.c co.mponents are 
7400 series logic, particularly 74LS, 74ALS, and 74AS circuits,- such as 
produced by Texas Instruments. Alternately, the buffer memory can be 
implemented with other components. 
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Buffer Memory Address Counters 



The buffer memory is composed of one line buffer, selected as an xnput 
line buffer and 3 -line buffers selected as output lijie buffers. Separate 
address counters are used to generate addresses for the input line, buffer and 
to qenerate addresses for tire output line buffers so that goading of data 
into the input line buffer can prpceed asynchronously with respect to 
outputting of data from the output T-ine buffers. The output address . counter 
is cligcussed relative to Fig 6X and the input address counter is discussed 
relative to Fig 6W below. ^ ^ . . 

Control loqic for the address counters is shown in Fig 6X, comprising 
flip-flops U1A and gates U1B-1, U2B-3, AND U.2B-6, Gate UlB-1 receives and 
Jnvferts the line sync signal . CLS^ for loading into flip-flops U1A The 
inverted line sync pulse 1% shifted through flip-flops U1A-2 and UIA-7 arid 
the leading edge iS detected with gate U2.B-3 .and the trailing edge is 
detected with gaxe U2B-6. Leading edge detection is performed by NANDing the 
once delayed complemented and, t.he twice delayed uncomplemented shifted 
CLS -signal with .gate U2B-3. Trailing edge detection is performed by NANDing 
the once delayecT uncomplemented ana the twice delaye.d complemented shifted 
CLS-sianal with gate U2B-6. Therefore, gate U2B-3 will qenerate a l-clock 
period negative going pulse at the. leading .edge oJE the CLS-signal and.g^te. 
U2B-6 will generate a l-clock period .negative going pulse at the trailing 
edge of the CLS -signal for synchronizing the input address counter and the 
output address counter to the line sync signal, respectively. 
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.As disc.ussed abpve, the input line buffer can be controlled to commence 
loading of information a£ the ^ svn . c period , t o pr ovi d e 

extra time To load Tne" line MFer >a tne Q^put liiie ~Pu£ter can be 
controlled to cotm^ at the end of the line, sync 

oeriod to synchronize out putting o£ pixel intormation with completion of the 



&f r *fci T 

^ n C?§c^Tandut logic is shown in Fig 6X, wjiere AND gat? U7B-3 receives the 
complemented early clock CPE-bar and provld^s a non-inverting delay and 
inverters U8B-2, U8B-4, and U8B-6 provide the inverted and delayed CPD clock 

signal^ out p Ut address counter \*ill now be discussed with reference to Fig 
6X r The output address counter is composed of .counters U2A, U3A, and U4A. 
This counter is connected as a synchronous 12 -bit counter by. connecting the 
TC-signal on p;Ln-15, the CEP-signal on pm-7, and the CET-signal on pin- JO 
between the different stages in th$ manner shown. Th$ output counter is 
clocked under control of the output pixel clock QPE-bar inverted and delayed 
to the CPD clock signal to generate 10 -address signals to the output address 
bus (or read. address bu$) .to the buffer memories. The output address coynter 
is cleared wp.th the trailing edge pul?e from U?B-6 to .the counter, clear input 
PE-baf on pin-9 at the encT of the line blanking period to. initiate address 
counting from the first address in the buffer memory coincident with the 
beginning of the line blanking CLS-signal. 
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The input address counte.r will now be discussed with reference to Fjg 
6W. The ipput address counter is composed of co.unters U5A, U6A, and U7A. This 
counter is corrected as a synchronous J2-bit counter by .connecting the 
TC-signal on pp.n-15, the CEP-signal on pm-7, and the CET-signal on pin- JO 
between the different stages, in th§ manner shown. The input counter is 
clocked under control of tlje input pixel gated clocjc CPG C3-22 to generate 
10-address signals to the input, address bus (or write address bus; to the 
buffer memories. The CPG clock is .the gated clock generated on the control 
logic board with gate U21D-8. The input address counter is cleared wq_th the 
leading edge pulse froip U2B-3 tg the cpunter <?l$ar input PE-bar on pm-9 at 
the beginning of tfcte line blanking period to initiate address counting from 
the first address m the buffer memory coincident with the end of. the line 
blanking CLS-signal. . . , , . , 

The buffer memory multiplexer control will now be discussed with 
reference to Fig 6W. The multiplexer logic has been discussed with reference 
to the BUFFER MEMORY MULTIPLEXER ASSIGNMENT TABLE above. Counter U8A is a 
modulo-3 counter, counting from 0 to 3 and then overflowing tp 0 again., It 
counts m response to the leading edge pulse from U2B-3T, inverted with 
U13B-10, and applied to tfte CEP and CET inputs to increment counter U8A. 
Consequently, cpunter UBA is incremented $t the beginning of each line sync 

gul^e for changing the buffer memory multiplexing on a scanline-by-scanlme 
asis. The modulo-3 count is decoded by decoder UJ2B to generate one of four 
mode signals; FO-bar, Fl-bar, F2-bar, and F3-bar in response to the state of 
counter U8A. The decoded mode signal controls the buffer memory 
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multiplexer in accordance with the assignments in the BUFFER MEMORY 
MULTIPLEXER ASSIGNMENT TABLE. 
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Line Buffer Memory . . , 

The line buffer mepiory lg composed of 4 -line buffers shaped to implement 
a multiple buffer configuration. These 4-line buffers are similar in design 



and operate under control of .multiplexer signals and address signals.. 

The first line buffer will now be discussed with reference to F^gs 6Y 
and 6Z. Four RAM circuits U3E to U6E are addressed through tristate 
multiplexers, U3C to U6C. Multip lexers U3C and U4C ^l.^ the, ., w 5 lte . addreps 
the write bus or inp^¥usT ana multiplexers^ UbC ana U6C select the 




applied t;o the write input WE-bar of the RAMS. .When the read multiplexer U5C 
aha U6C is selected, the read address is applied to RAMs U3E to USE and the 
write pin-10 ytfE-bar is pulled up to select read operations. 

The RAIVJ input and output lines 1 01? to IQ3 are shared be.tweeji outputt^ng 
of information in tfre r.ead mode and. inputting of information in the write 
mode. Jnput information, is selected withT.ine buffers U4F to U6F, which apply 
input information obtained 

347 

from the input bus to the RAM 10 l^ines in the write mode ^nd which are 
tristate-disajDled .to disconnect the input information on the input bus from 



tfce RAM 10 lines in ,the read mode. Line buffers U4F to U6F are controlled 
with the FO-bar multiplexer control signal to connect tne input pus to the 
ram IP lines wnen"the address and the write 

puisgjtnrpugft multipIexers~U3C and u4c and to disconnect the input bus from 
■ ghe fiArt 10 fines Tw^eg the" -Bar signal enables Ine read" addres s "and disables 
write address and write pulse. H^nce, line butters U4F to U6F are enabled 



le write address and write "pulseT rtgnceT line au± fers 04 F to 05f "are enabled 
when thQ ran channel is in the write mode and are disabled when the RAM 
channel is in the read mode. As cap be seen, from the schematic, line buffers 
U4F to U6F $pply the 8-intensity bits from image memory over the buffer input 
bus to the inputs of RAMs U3E and U4E. and apply the weight addresses from the 
addresp aenerators over the buffer mp.ut bus to the inputs of RAMs USE and 
U6E, with 2 -spare bit? presently upassigned. , _ 

Output information is multiplexed onto, the buffer output buses; 
identified as the channel-I bus, the channel-II bus, .the channel -J 1 1 bus, and 
the weight bus. The 3-channel Ipuses comprising the pixel intensities from the 
3-Qutput line buffers, are applied to the 3 -channels of kernel registers. The 
weight bus, comprising the weight; addresses of the selected,, channel, .is 
applied to the single dnannel of weight registers U22A and U22B for accessing 
the weight RAM. 
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^ , The s-int e nsit jy ^ lines from , RAMs U3E, .and . P4B. are .applied tn all 

3-charmels through "different mult lplexers so that the intensity lines can be 

--^-ut chanftgls or tor none of the 3-output 



selected for one of W 



channels under Tpntfoi bt mui^i^Iexers"L[3 Because" each intensity 

parameter and each output channel' has 8-bits, because each multiplexer U3D to 
U6D has 6-bitp, and because the 74LS367 multiplexers can each control 



cnannei-i. with multip lexers u&u anq ubij ror channel -11, , . ana With 

multiplexers" USD and U6D tor channel-Ill. The specific partitioning of 
intensity £>its ana multiplexers is shown in the schematic diagram. The 
multiplexing of ^ the inten sity frits ontpo the channel 7 1 b^is i^ controlled with 




iultip~rex er^^ ot multiplexed 

AltipXex er, U4P, The muitipig^igg ot __tfle_intensit ' ' 



hannel-I bug 
trol all of 



— . -_D and 

e onto _ the 
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ii 



mul t fpjex 1 tne in^ens^y^St I I rom ^^^s^ U3ET ^hd " onto ', one ~bf7the~3 - output 



E 



gntrol 2-ftitg qY multiplexer 
tlY, multiplexers ujd zo U6D 



toe 
onsequen 



channel buses yncjler control .of the multiplexer control signals in accordance 
with the .definitions shown in the BUFFER MEMORY MULTIPLEXER ASSIGNMENT TABLE. 
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The 6 -weight address lines are applied to the weigh.t bug under control 
of multiplexer U6B as output from RAMs USE and U6E . This first RAM Ipuffer 
line outputs to the weight , bus under control of the F2-bar signal. 
Consequently, when the first line buffer is selected with the F2-bap signal 
to output the stored intensity onto the channel -II bus through multiplexers 
U4p arid USD, the weight addresses from RAMs USE and U6E are applied to the 
weight bus through multiplexer U6B under control of the F2- bar signal. 

The second fine byffer will now be discussed with reference to Figs 6AA 
and 6AB. Four RAM circuits IJ7E to U10E are addressed through tristate 
multiplexers U7C to U10C. Multiplexers U7C ^nd UBC select the write address 
from the write bus (or input bus) and multiplexers U9C and UIOC select the 



read address from the read pus (or output, bus) under control, of the mode 
control signal Fl-bar U12B-5 in accordance with the logic shown in the BUFFER 
MEMORY MULTIPLEXER ASSIGNMENT TABLE . Mult iplexers U7C and USC are selected 
with the Fl-bar signal and multiplexers U9t and U10C are selected with the 
Fl-bar signal complemented with U13B-4. The selected address is applied to 




write address is. applied to RAMs U7E to U10E and the write J>ulse CPG is 
applied to the write input WE-bar of the RAMS.. When the read multiplexer U9C 
and U10Q is selected, the read address is . applied to RAMs U7E to U1UE and the 
write pm-10 WE-bar is pulled up to 

350 

select read operations. „ . , , ^ ^ 

The RAM input and output lines IOQ to IQ3 are shared be.tweep output tq.ng 
of information in the read mode and inputting of information m the write 
mode. Input information is selected with J_me buffers UBF to UIOF,. which 
apply input information obtained from the input bus to .the RAM 10 lin?s m 
th§ write mode and which are tnstate-disabled to. disconnect the input 
information on the input bus from the RAM 10 lines, lp the read mode Line 
buffers UBF to U10F are controlled with ii\e Fl-bar multiplexer control signal 
to connect the input bus to. the RAM 10 lines when the Fl-bar signal enables 
the write address and the write pulse through multiplexers U7C ana U8C and to 
disconnect the input bus from thfe RAM 10 lines when the. Fl-bar signal enables 
the read address and disables the, write address and write pulse .. Hence . line 
buffers USF to UIOF are enabled when the RAM channel is m the write mode and 
are disabled when the RAM channel is in the read mode. As can be seen .from 
the schematic, line buffers U8F to UIOF apply the 8 -intensity bits from image 
memory over the buffer input bus to the inputs of RAMs U7E and U?E and apply 
the weight addresses from the address generators pver the buffer mpvt bus to 
the inputs of RAMs U9? and U10E, with 2 -spare bits presently unassigned. 

Qutput information is multiplexed onto the buffer output buses; 
identified as the channel-I bus, the channel-II bus, .the channel-Ill bus, and 
the weight bus. The 3-channel puses comprising the pixel intensities from the 

3- outpuE line buffers are applied to the 3-channels of kernel register?. The 
weight bus, comprising the weight addresses of the selected channel, is 
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applied to the single channel of weight registers U22A and U22B for accessing 
the weight RAM. , , 

The 8-mtensity lines from RAMs U7E and UBE are applied, to all 3-chan- 
nels through different multiplexers so that the intensity lines can be se- 
lected for one of the 3 -output channels or for none of the 3 -output channels 
under control of multiplexers V7D to U10D. Because each intensity parameter 
and each output channel has 8-bits, because each multiplexer U7D to U10D has 
6-bj.ts, and because the 74LS367 multiple xers can each control separately 

4- bits and 2-bits. the B-bits selected to r one of 3 -channels are partitiojjea 
betw een a pair of waltip+exe r s . For example,., the intensity, bits f rom rams uys 
anq , ypfi ar |T co ntro lle d ana Uftp, lox channel- ir witn^muT^ 

tiplexers~y8D"ancL U9P"fpr channe l- II. and witn multiplexers U9D and U1QD tor 
channel- III . The specific partitioning ot intensity bits ^nd multiplexers is 
shown in the schematic diagram. The multiplexing qg the intensity bits onto 
the channei-i bus is controlled ydfch tne, f£-^ signai m g5 
contro l all ~pT , multip lexer" y7D ana ^ 2-bits ,o£.,L multiplexer ubp. The 
m u it ^ i exing ot cfte int ensity byte, onto the channel -iibus is controlled wSEE 
tJ ft§ v^7b?r iTiuitipiexer control signal , to control j-sits ot multiplexer y 
ana 4"- p its ot" m u ltiplexer ugp", Jcjre r jffui tip^xing o£ tne intensity byte . on 
the channel- 1 ii , pus I s controlled wijA the" FOrbafc multiplexer, control- sign 



annei-ixi ,bus Tj? cd^ mulcipjj^ 

control, 2-frits ot; multiplexer UgP anfl 1A aiJL 6-bits "ot multiplexer viql)^ 
ntly . , inuit iplexers TJ7& to Ul 0D multiplex the 8 -intensity bits from 
ana ubh on to on e ot : the ^-oWput cnmnel buses under control 
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pf the multiplexer control in accordance with the definitions shown 

in the BUFFER MEMORY MULTIPLEXER ASSIGNMENT TABLE. 

The 6-weight address lines are applied to the weight bus under control 
of multiplexer U10B as output from RAMs U9E and U10E. This first RAM buffer 
line outputs to the weight bus under control of the F3-bar signal. 
Consequently, when the first line buffer is selected with the F3-bar signal 
to output the stored intensity onto the channel- II bus through multiplexers 
UBI? and U9D, the weight . addresses from RAMs U9E and U10E are applied to the 
weight bus through multiplexer U10B under control pf the F3- bar signal. 

The third line buffer will now be discussed with reference to Figs 6AC 
and ,6AD. Four RAM circuits U11E. to U14E are addressed through tristate 
multiplexers U11C to U14C. Multiplexers U11C and V12C select the write 
address from the write bus (or input bus) and multiplexers U13C and U14C 
select the read address from the read bus (or output dus) under control of 
the mode control signal F2-bar U12B-6 in accordance with the logic shown m 
the BUFFER MEMORY MULTIPLEXER ASSIGNMENT TABLE. Multiplexers UI1C and U12C 
are selected with the F2-bar signal and multiplexers U13C and U14C are 
selected with the F2-bar signal complemented with U13B- 6. The selected 




address is applied to the address inputs on RAMs U11E to U14E. The write 
multiplexer U12C also multiplexes the write pulse to U12C-11 and to the write 
inputf to the RAMs WE -bar oh pin- 10. When thfe write multiplexer U11C and U12C 
is selected, the write address is applied, to^RAMs U11E t5 U14E and the write 
pulse CPG is applied to the write Input WE-bar of the RAMS. When 
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the read multiplexer U13C and U14C is selected, the read address is applied 
to RAMs. U11E to U14E and the write pin- 10 WE-bar is pulled up to select read 

operations^ input and out p Ut lines IOQ to IQ3 are shared be.tween out put ting 
of information in the read mode and inputting of „ information in the wr4.tr 
^ ...r , ..-.--^-j ---.th l^ine 



mode. Jnput information is selected wi 



buffers U12F to U14F, which 




input 




U12C and to disconnect the input bus frdm the RAM TO .lines when the F2-l?ar 
signal enables the read address and disables the write address and write 
pulse. Hence, line buf fers .U12F to JJ14F are enabled when the RAM channel is 
in the write mode and are disabled .when the RAM channel is in the read mode. 




een from the schematic. 



e buffers TT^2F to Ul 4 F apj 



htiller" input bus to tne input 



_thi 



rom image memory ovi 



jmd U12E and apply cfte weight address es . troft the aagress generators 
butler inpli^ Ms t o the input sot l£&Ms uf Jfl and PI*S~ with 2- spare 



bits present 



Output information "is multiplexed onto the buffer output, buses?. 

rientiFiegT as the" chamnei-i ks^ the ^^ channei-ll bus, the channel-Ill Pus^. and 
fie weight Pus . me A- channel buses 
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comprising the pixel intensities from the 3 -output line buffers are applied 
to the 3-cnanners of kernel registers, ™ * " ~ " 



addresses 
registers 



of the selected channel, is a; 
U2 2\ ancf TJ22B tor access 
8 - in t ens 1 t y ~ 1 



the 3-cputput line butters are applied 
The weight bus, comprising the weight 
^^l^^t^^j^^^n gie" channel ot weight 

s U±¥!Z 1 ^riri JjI'Ie are applied to all 




multiplexing r ot the" intensity byte onto the annex -I II Pus is contro 
with the Fl -Par multiplexer control signal to control 2 -Pits ot multipl 
U13D and all fe-Pnts nf. multiplexer U14D. 
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^gftt , bug .through muitxpAe^er Ui4B under cpntroi~Qt, w MV „ v — y „„ ^ a »^ 
The tourth line Putter vnii now pe discussed with reterence to Figs 6AE 
and ,6AF. Four RAM circuits U15E. to U18E are addressed through tristate 
multiplexers U15C tp U18C. Multiplexers U15C and U16C select the write 
address from the write bus (or input bus) and multiplexers U17C and U18C 
select the read address from the read bus (or output ous) under .control of 
the mode control signal F3-bar U12B-7 in accordance with the logic shown in 
the BUFFER MEMORY MULTIPLEXER ASSIGNMENT TABLE, T " -~ 



elected with 



are selectee 

selected wit 




he ej 
led to tne address input 



F3-ba,r 



signal and mul 
.1 complementert_ 



tip. 




U16C 



ie_ "seiecFp 



MSB \p UlMfa. The wriTe 
e pulse r o nUL'-il and to tne wnr.P 



xes s 

multipiexe 



ne address lnpn 
tiPl exes the wr £ 



s on. 



inputs to 



bar 
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on pin- 10 . When the 




IJ15C and TTlfiC: is selected, the write 



ess is a^ 



write inp u 
leased, j 



anatne write 



; ana the write 

ar iB puIIeH im fc o aeiefet reaci operations" ~ ~~ 

rinputf ancf ouffiulE w linea I0Q Eol03 are snared between outputti 



j.8 seiegte 
pm-io we- 



The RAM input? and onKfrut lines iuu to IQ3 are shared De 
of inTormafion^in the read mode and input ting p£ inrormaE 
mode. In p iiF'Tnrormation is selected with line butters UlbJ 
apply input lnforroatfion detained, tro^^ 

^BE Vrffi moae"a nfl to aiscc 

inf ormation on the innufc bus trom the ram iu lines, in the 



ft e wri 



TSf. whir.. 
O lines in 



gd to qisconnect trie inpu 





lines u when the F3- 
e through multiplexer 
RAM IP lines " when 



i p lexer con 



with J- spare hits presently unassianed 
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Output information is multiplexed onto, the buff er output buses; 
identified as the channel-I bus, the channe^-II bus,, the channel -J 1 1 bus, and 
the weiqht bus. The 3-channel buses comprising the pixel intensities from the 
3 -output line buffers are applied to the 3 -channels of kernel registers. The 
weight bus, comprising the weight addresses of the selected channel, .is 
applied to the single channel of weight registers U22A and U22B for accessing 
the weight RAM. . . n>J 

The 8- intensity lines from RAMs U15E and U16E are .applied to all 
3-channels through different multiplexers so that the intensity lines can be 
selected for one of the 3-output channels or • for none of the ,3-output 
channels under control of multiplexers U15D to U18D. Because each intensity 
parameter and each output channel has 8 -bits, because each multiplexer U15p 
to U18D has 6-bits, and because the .74LS367 multiplexers can each control 




channel- 1, with multiplexers U16D and U17D f or cftaiinel-II .and. with 
rpultiplexers U17D and U18D for channel- III The specific .partitioning of 
intensity bits and multiplexe.rs is shown in the schematic diagram. The 
multiplexing of the intensity bits onto the channel- I bus is . contrc5lled with 
the FO-bar multiplexer control signal to cpntrol all <?f multiplexer U15D and 

2 - bits of multiplexer U16D. The multiplexing of the intensity byte pnto the 
channel- II Ipus is controlled with the Fl-b.ar multiplexer control signal to 
control 4-bits of multiplexer U16D and 4-bits of multiplexer U17D. The 
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multiplexing of the intensity byte onto the channel- III .bus is controlled 
with the F2-bar ipultiplexer control signal to control 2 -bit? of multiplexer 
U16D and ^11 6 -bits of multiplexer U17D. Conseguently . multiplexers U15D to 
U18D multiplex the 8 -intensity bits from RAMs U15P and U16E onto ope' of tlie 

3- output cnanjiel buses under control of t;he multiplexer control signals m 
accordance with the definitions shown in the BUFFER MEMORY MULTIPLEXER 
ASSIGNMENT TAIjSLE . . . . 

The 6-weight address lines are applied to the weight bus under cpntrol 
of multiplexer TT18B as output from RAMs U17E and UIBE. This first RAM puffer 
line outputs to the w.eight .bus under, control of . the Fl-bar signal. 




the weight bus through multiplexer U18B under control of the Fl-bar signal. 
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Kernel Logic 

The Kernel logic for spatial processing will now be disc.ussed with 
reference to Fig 6ACT. This kernel logic includes a 9 -pixel kernel implemented 
with registers TJ19A to U19D, U20A to U20D, and; U21A*to U21D. 

The 9rpixel kernel i$ composed of 3 -adjacent; buffered lines and 3- 
adiacent pixels on each l^_ne. The 3-line? are shifted out of the, 3-line 
buffers into a 3 -pixel register for. each line, buffer. Because each pixel is 
shgwn implemented as $n 8 -bit intensity word and because each register has 6 
flip- flops, 1-1/3 register chips are needed to store a pixel wor<l. Therefore, 
the 3-lines of 8-bit pixels are stored in 4-lines of 6-bit registers. 

Referring to the pixel designation, of Figi.SD, tlje following pixel 
storage is implemented with the kernel registers. *PixeI-0 is stored m $-bits 
of U19A and 2-bits of U19B. Pixel -1 is stored in 6-bits of U20A and 2 -bits of 



U20B." Pixel-2 is stored in 6-bits of U21A and 2-bits of U21B, Pixel -7 is 
stored in 4-bits of U19B and 4-bits of U19C. . Pixel T B is stored in 4-bq.ts of 
U20B and 4- bits of U20C. .Pixel -.3 is stored in 4 -bits of U2 IB and 4 -bits of 
U21C. Pixel -6 is stored in 2 -bits of U19C and 6 -bits of U19D.. Pixel -5 is 
stored in 2-bits of U20C and 6-bits of U20D. Pixel-4 is stored m 2 -bits of 
U21C and 6-bits of. U21D. , . ^ r . _ , 

The above assignment, of 8-bit pixels to 6 r bit registers can be seen with 
reference to the output lines at the left of Fig 6AG. xhese. output lines show, 
the 8 -lines grouped together for each of the 9 -kernel pixels and show the 
source registers for these lines. 
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The 3 -lines of pixels are scanned out of the line buffers onto the 

._, , , -i^-r-r i channel III bus; as shown at. the left hand 

i -channel scanline pixels are, each 
to registers U19A to U19D with, the 
■ 8. -bit pixel bytes loaded into 



kernel 
registers 
as pixel. - 

as pixel-2, pixef-3., and pixel-4 respectively of the kernel. This shq.ft 
register operation is perfSrmed under control of .the CPE clock USB-4 which 
clocks the information out of the line puffers, ^nto the kernel registers, 
and through the kernel registers to provide a 9 -pixel kernel in parallel to 



the spatial filter logiq 
In a non-filterea l 



yideoTBRTs "cm" the rear '&na^oarg t ^ 1 Slspiay~Jhe cenCer pixel Without s pa 
tilterinq, The center pixel is shown output on cable C-4 lines 22, 24; 21 



n. the center pi xel is provided to th 
• the center Pixel ^wit 



?atic 



TS7 



ring , 

iO , 32 , 34, and 36 
In a spatial filter 



spa t P iaT^ tif te^ino 3 ^ ^he output o: 
provided to the video DACs on the 



viQefi~Tn ~ parallel ipqic tttat performs 



im plementation.^ the_out^P u£_Qf | the„ 9-^^i^el^kernel 



u£ put""ot "the" sum-ot^^tBe^produl^s processing is 



361 



rear-end board to display the spatially filtered Pixel. The 
shown output in parallel^ tnrouafi £he 72 -lines (9- Pixels bv 
at tne Ifl t nancf aide ot fig e>At4. 



i-pixel kernel is 
i -Pits per pixel) 
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Weight Logic 

The weight logic will now be discussed with reference to Fig 6 AH. The 
weight logic is implemented with registers U22A and U22B; decoders U22C and 
U22D; RAMs U21E to U23E; and multiplexers U23C and U23D. , . , 

The weight addresses stored in the line buff ers are output to the weight 





3E eX 1xi S ri ng t ne 1 ^ 5 f mc * 



e compter can generate weight a 

fits ^gp^a" - W - 1 - qnt: 



messes 



rough thepu 



or writ ih( 
multiplexer; 



S: wnere 
ied to weig 



I 



and 



ana aye appj 



The RAM IO lines 100 to IQ3 are used for both input and output of data, 
CQntrolled with the WE-bar pins. In the run mode, , the W2-bar an<3 W3-bar 
signals to the WE-bar pins are. high, selecting reaqmg from. the weight RAM 
for outputting on the RAM 10 lines to the spatial filter logic. In tne load 
mode, the W2- 
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bar $nd W3-bar signals, can be controlled by the computer to be .low, selecting 
writing into the weight RAM fr.om the computer output signals througn 
multiplexers U?3C and LT23D. The weight addresse.s stored m register U22B are 
output to multiplexers U22C and U22D for accessing of weights from the weight 
RAM" when selected by the run mode signal to multiplexers. U22C and U?2D. The 
weight addresses from the computer Output port are applied to multiplexers 
U22C and U22D for storing of weights in the weight RAM" when selected by the 
load mode signal to multiplexers U22C and U22D. 

The weight bus communicates the weight address b.its from tfie line 
buffers to weight register U22A; wljere the weight address J.S, shifted into the 
weight registers to address the weight RAMs in a manner similar to the pixel 



intensities being shiftecj into the kernel registers for spatial filtering, as 
discussed above. The weight addresses are Composed of the Y-weight address 
YWOB, YWJjB, and YW2B and the X-weight address XWOB, XWLB, and XW2B shifted 

int ° Muftiplexers U22C and U22D select the addr.ess for the weight RAMS , 
comprising the buffered weight addresses from register U22B in the run mode 
^ncTthe computer generated weight addresses XWO, Xwi, XW2 , YWp YWl and YW2 
in the lo&d mode when t;he .computer is loading, the. weight RAMS. The 
multiplexer source information is selected with the load/run signal from, the 
computer. The addresses frpm the multiplexers are .used to address the weight 
RAMs to access the apprppriate weights as a function of the weight addresses 
from the line buffers in the run mode and to 
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stQre 

weight caresses iii.txie — „ ^ ,-^ m^ n 

writing into the weight RAMS f The data to be loaded into the weight RAMs in 

, „ tri ,^ te flutters^ 



MWH , the computer generated weights as a function of the computer generated 

weight addresses in . the load mode when the W2- bar of W3-bar signals select 
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REAR-END BOARD 



rovidgs 

o£ the 



The rear-end board interfaces the system to a CRT monitor and p 

synchroSSi z at^ ana tor the rest — 

sysFem. The rear"e auxiliary tunctions. such as 

converting analog joystick signals to digit a JL "fpgn for control ot a display 

§ rocessor . The rear-end board is shown in^Figs 6S to 6V in detailed schematic 
lagram rorm. ... . , ^ . 

A clock pulse generator 630A is implemented with a pair of inverters, an 
18.432-MHz (herein referred tp as 18-MHz for convenience! crystal, resistors, 
and capacitors as shown in Fig.6T to generate a .square wave signal from in- 
verter 630B pin-12..A counter cir.cuit (74LS163N) lq clocked from the inverted 
18 -MHz signal to pin- 2 through mvert.er 74LS04 pin 2 for counting down the 
18 -MHz pignal to about a 9 -MHz clock signal for the display processor cputpyt 
from pin- 14 $nd about a 2 -MHz clock signal to ,the sync generator circuit 
MM532Ifrom pm-12. A grgup of 4- switches with , pull-up resistors are 
connected to the prejLoaa inputs of the counter on pins 3 tQ 6 to preload a 
selected amount for impl eventing count periods .other than binary numbers. 

A synchronization signal generator j_s implemented with a NatiQnal 
Semiconductor MM53?lcomponent.. jhe IWI5321 is connected a,n a .usual fashion, 
such as described m the specification sheets and. shown m Fig 6T. Switches 
D.C., V.R., and H.R. select MM532 . modes . of operation. 

The MM5321horizontal drive signal is output from pm-15 and is used to 
lplank the digital to analog converters (DACS) and is output through an BT98-9 
inverter H-DkIVE for generating the 
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horizontal sync signal or line sync signal CLS tp the digital logic Ipoards. 
The horizontal cjrive signal is also output to flip-flop Ul-9, which is used 
to experiment with horizontal blanking HB signals. 

The MM5331 vertical driye signal is output from pm-11 aijd is used . to 
generate vertical blacking signals thrQugh £n 8T97-5 to vertical blanking 
flip-flops U2, generating vertical blanjcing signal V$ which is us$d to blank 
the video DACS . The vertical blanking signal V^U2-? is buffered with 8T97-11 
through cable C4-2 to apply the vertical blanking signal to the digital logic 
as the CFS signal. * . , ■ - • . „ • 

The MM53^21 composite sync signal is output from po,n-16 and is used as 
the composite sync signaj. to the CRT monitor, Touffered with an BT97-3 and an 
8T98-3 Tor complement .signals. . „ . ' ^ . , . ' 

The MM53Z1 blanking clock signal is output from pin-1.4 and is used, to 
clpck the vertical blanking flip-flops U2 and the horizontal blanking 
flip-flops Ul-9 HB through an inverter ^T98- 7 . The M^I5321 interlace control 
signal is output from pin-9 . and is used to control flip-flop Ul-5 fLD-bar to 
generate the fp-eld-l-par .signal on cable C4-12 to the control logic. board. 

joystick. input circuits are, shown inFigs gU and 6V. Fig 6U_ provides the 
controTcircu^^ to digit aJ, converters (ADCS) and^Fig 

6V shows tfteTWcs. z g £ne "a router through the control 

Iogic^oara to pro^ op . display processing." " 

The joysticks utilized in this configuration are Appre-2 Compatible 
Joysticks named Computer Compatible Joystick. They 
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control . The 
m-7 for 



connection to the scaling amplifiers ^nd ADCs shown in Fig 6V. Tfre ADCs are 
controll ed to start the conversion with the frame sync transition ot the 



being in the f-Vta^ generate a i- clock Per lod start 
convgrg pulse lo t¥e AbcS . ^Ee aDCb will start the conversion in" resgonse'to 
this'sta^t" convert pulse and will latch up the converted digital number tor 
input'to the computer under program contra il . . _ ~~7 ~^ 
Tne two computer signars selu and SELl are received from the computer 
through the control logger board to. select on,e of four ADC numbers, for Input 
to the computer. These signals are inverted with U13-7 and 1113-9. The invert- 
ed and non-inverted SELO and SELI signals a^e decoded with Ull-3 for ADC 
1-seleqtion with signal SI, ADC-2 . selection .with signal S2, ADC-3 selection 
with signal S3, ancf ADC-4 selection with .signal S4 . Inverters U10 arid U13 
received signals from tphe ADCS, shown in Fig bV, and buffers these 9-signals 
to drive the cable for input to the computer through the control logic board. 
lently, the computer undgr program control generates select 




under proa 
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The 4-ADCs and associated scaling amplifiers are shown in Fig 6V. The 

ADCs are implemented with the wq1V j kncWn ADC080Q components, such 

manutactured r by "Rational Semiconcfactor . Time scaling" ampli tiers are 
implemerited with the well; Known 17g^6 ampii tiers . Each ot tne 4-ioystick 
inputs from plugs PJi and PJ2 [Fig 6U) are snown connected, to a different ADC 
channe} through a scaling . amplifier Ul, U2, U5, anc} U6 (Fig 6V) . The scaling 
amplifiers are connected m a conventional manner. with re$i$tor and . capacitor 
networks to scale the joystick signals. .Each scaling amplifier has its output 
on pin-6 connected to the input of . its related ADC on pin-12. The ADCs 
convert the analog signal input at pin- 12 in response to the sta^t convert 
signal to pin- 6 and, latch the converted number in an internal register. The 
internal register is implemented with a tristate output controlled by the 
output enable signal to pin-7. The .corresponding output lijies of each Apt are 
connected together to form an B-bit bus DO to D7 which is routed to buffer- 
amplifiers U10 and U13 (Fig 6U) . Consequently, \yhen one of the ADCs is 
tristate-en,abled with one of t)ie decoded select signals SI to S4 (Fig 6V) 
input to pin- 7 of the ADCs (Fig 6V) , tfte number converted by that ADC is 
applied to the 8-bit data bus , for communication to the computer. 

,One channel of video. PAC is shown in Fig 6S, ^Eafih of the three channels 
a re impl emented with fcigna4£» 7except that .the green, channel , having 

3~bits ' "i s 7gonnected tQ."QaEfl b^ts gs. to j>7 an& tag re~d ana blue channels 
Raving 7 2 ~- hit ? are T connected to data bits P6 and PZ 7 These video dacs are high 
speed" DACs tor 
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converting intensity signals fajorn digital signal , fQrm, as generated by the 
display processor, to analog signal form fpr exciting a CRT monitor. Three 
video DACs are used to convert three video signals; the red video signal, the 



rovided herein. The p9 and D10 .data pins are connected to 
ground. The digital red and bl^e signals having 2 -bits resolution $re 
connected to the D7 and DB data pins. The digital green signal having. 3 -bits 
resolution is connected to the Db and D8 data pins. The other data pins are 
connected to ground. 

n Byfger amplifie rs ^ar e implemented with .the well Mown, ^buffer 

amplifier, where the butter amplifier connections are snown in Fig 6S. The 
output ot each butter amplifier "excites one of tne red, green, or blue imputs 
to the tRT monitor. 
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Video DAC connection table from specification omitted herein 
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CIRCUIT SPECIFICATIONS 

The circuit? used in the experimental system are generally commercially 
ayailable circuits that are well known and that are described m widely 
distributee?, specification sheets and component catalogs. A list of these 
specification sheets and catalogs is provided hereinafter and the materials 
referenced therein are incorporated herein by reference. For example, the 
74LS00, 74ALS00, and 74AS00 specifications are set forth in tl>e referenced 
Texas Instruments and Motorola catalogs and the Intel 6216 bus interface and 
the Intel 2149 RAM specifications are set forth in the referenced Intel 
catalogs; which are herein incorporated by reference. 

1. Texas Instruments, ALS/AS Logic Circuits Data Book, 1983. 2. Texas 
Instruments, The TTL Datas Book, Volume 3, 1984. 3. Texas instruments, The 
TTL Pocket Data Book, 1983. 4. Intel, Component Data Catalog, 1981. 5. Intel, 



Memory Components Handbopk, 1984. 6. Motorola, Schottky TTL Databook,. 1981. 
Various circuits used in the .experimental .system are .described in the 
following list of component specif lcation^ whidh are.herein incorporated by 
reference. 1. TRW, LSI DA Converters. TDC1G 116 J- ,8/9/10 . 2 . TRW, Monolithic 
Video D/A Converters; TDC1016J-8 . TDd0106J-9, TD£ip>6J-10; 197*9. 3 Texas 
Instruments, TMS-4016. 2048-Word By S-Bit Static RAM. 4. National 
Semiconductor, ADC0800 8-Bit A/D Converter. 5. National Semiconductor, MM5321 
'TV Camera Sync Generator. 
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6. Signetics, Hex Buffers /Inverters; 8T95, 96, 97, 98. 7. Mitsubishi; 
M5872SP,S;P-15,S-15; 16384-BIT (2048-word by B-blt static RAM. 

373 

PREPROCESSOR 

374 

General Description . . ._ ^ ^, 

A preprocessor may be used in conjimction with the system of the present 



image me mory. It can be used tor 

- ~ j ~— S ucn as tor- 



nee*: 



■ ias: 



Pi Itering may be; needed tfo "reduce trie " spat tal frequencies to overcome 
aliasing thar my ha caused witn t he geometric processor or the preprocessor 
compressing the 'image . 77 ^ ~ . . , , . 

The image received from the source of the image can be buffered in a 
buf f erinemory tor prepro cessing. Trie buttered image can be loaded into image 
memory tor geomet ric processing when the geometric' processing goes bevond the 
limits or t:he image stored in image memory For example. When the Image in 
image memory is to - 5e tran sited pa^t a Bouhdary ot image memory, or is to be 



image mem ory is to' fie translated pa^t a Boundary or. image memory, or i 

impresse d iheiow a compression tnreshoid. or Otherwise processed bev 

limits or tlie im a|e7 tlie buttered image can ae loaded into image memory to 



ond the 



continue geometric- processing 
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overlaying from a slower databa se memory, and can oe used as an ottline 
preprocessor me mory: such as tor compressing, filtering, decompactmg . and 

snaggy process^ngCr 77777 7 . , , ^ 7 

~ " An input butTer memory capability can be provided between a slower speed 
database m&ryrsucn as a dis^ memory, and a higher speed image memory, such 
a high speed RAM .The input ^butter memory can De implemented with RAMs tor 
interfacing the lower speed database memory and the higher speed image 
memory, image mtormatiori can be overlayed from databa 
input 'Putter-, such as in response to looicanead processing 
can pe overlaye d trom the 'input Putter into the_ image- 



can be overlaye d from theinput Duffer into the image memory, such as in 
response to geometric processi.ng causing the window t'o approa-cn an edge ot 
image memory 7 The input buffer may have" an access time that is logu-times 
Petter that- 1 a dalaBa^e" memory access time. Therefore, this may reduce The 
size requirement for the higher speed and hence higher cost image memory 
because V.he image memory then does "not have to accomodate 



le image memory 
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longer access delays fro m database memor 



■r access delays from database memory. 

An input buffer memory can be used as an offline pre-processor memory 

AS discussed herein. compression. filtering. and 11 decompaction THa^ 

decompression) can be performed before loading image memory, such as tor hig 
levels of comp ression and tor an anti-aliasing "low pass filter. A filter 
processor haying Kernel and sum ot the product a loaie can be connected for 
Operation" wTtn cne inp ut butter. A compression processor, such as discussed 
herein with the geometric proces sor, can be connected tor operation with the 
input butter, as discus sed herein tor connection and operation with image 
memory. Also.- shadow processing can be performed before loading image memory, 
such as by proj ecting a source ot lnumination onto topological air.ifn; 
variations of the image and storing proiected shadows in the pixel words. T 



-^ions of the image and storing proiected shadows in the pixel words. The 

image ha ving filtering, compression " de'compaction . and shadow processing can 
be overlayed into imagp memory no facilitate geometric processing^ 
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Progressive Compression 
Compression ■ 




is because 



generator 

Kernel 



ii sucn as a 9- pixel Kernel;, pur, may — qe_ 

ntaneousiy. depending on the lmpJLementacion. 
Tmprgvea Vijjrtfri by compre 

st'enf witfi TAe i H Jiar kernel size aria we toff 



ay or may not 



ins 



r essin<^ w^th macmitujft 



sistent with the filter kernel size ana weights. ypr~ example, large 
prfission. sucn a s" V"bg 3. compression. can exhibit undersamprCng 
racCeri&'icd i even when filtered witK^a T-pKxeJL kerne l . VgHis is"5icause tni 
tial period is significantly lower, than the kernel width or period, such 
a 5 -pixel sample T»eripd~ and a 3 -pixel kernel jperiod. Improved smoothing 
be obtained by maintaining the sampling period within tne kernel peripdT 
h as a sampling per lod ol 2 -pixels of less tor a 3-pixel kernel .__Tnis 



consul 



cpmpressip: 



characte ristics even 



spat 
a 

can 



such " as a" sanpling perioa o. , „ x — T „ — „ ~, — 

reduces T un dejr¥aWii%T "preserves image detail, reduces aliasing, and permits 
display o t HefcafTs reaflced to subpixei size" ~ ~ . . " 

Tfis coWina^V Tri roTr^edu^tiofl'or under sampling and obtaining of large 



compressions ca 



i can be obtained with 
wiEhout ; undersampTl: 



— . -- ndersampllng ■• multiple compression . 

compression ot "2 -times or less ca n be" performed to obtain compressions o 
greater than 2^times, For example, similar tg the arrangement discussed witn 



_ JUL] _ 

rogjressive compression . For example . 

sis ion, it erations havin 



S 



reference to tne COMPRESSION PARAMETERS TABLE provided Herein: a compression 
ot 12- times can 
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Progressive compre 
exponent ial reiatiQn^ni 
image is compressed, tri 



assign yields et ticiencies m addition to the above 
- tor progressi ve compression. For example, as an 
number ol pixels in that iiqage is reduced. It tne 



sed rate . For examp 



compression can proceed at an incr 
progressive^ gomprg s s_ion Qjxa japj, e 



secon 
in 



ixel &y. 



size is compressed to about 



lxel?) compre s 



)- pixels 



mes a 



?ixej 



progres 



4- times as 




size squared eg 
the image trom" 
compression it 



sses 



6^pixe I s_ "to 128 -^.xei ■s/pY.J-jt- pixels in _!_/ 4_ ot ^a compression Jit era tioh 



because there are only r 1/4 T pt the numbe r ot pixels to be compressed in this 
progressively compresse d imagg. Ther'^ 
progressive compression (i.e. 



pixel s_j 
image. Therefore: thg 
^.-iterations ot 1/2- 



exponent ial nature ol 
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compression for a 32 -times compression) is further exponentially improvement 
-- jt. -~ - time as the image becomes more compressed. Conseguentiy 



m comp ression t ime as the image becomes more compressed. Consequently, 

progress ive compressions or even nigh compression -amounts and even with 
relatively small kernel sizes will progress "rapidly . 
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Outer Loop Correction 




illus 
images 



he database and then updated to the present conditions, 
n example ot an outer "loop correction will now be provi ded to better 
rate an implemen tation Ks discussed herein, a plurality or mosaic 
can be loaded from datab ase into image memory and can be progressively 
sed m image memory to provide a progressively updated image. As the 



processed in image memory As the 

image is progres sively updated." errors te'nd Ho be cumulative. The errors may 
be in the form qt spa tial p ositional errors, intensity err ors, and other 
errors. An outer loop correction can be implemented by reloading mosaics from 
the database into image memory thereby" re-initializing image memory and 
ettectively nulling; out accumulated errors. The new initial c onditio J ns~in 



effectively nulling out accumulated errors. The new initial c onditions in 
image memory can then be updated to the image conditions t hat exisTed 
immediately -prior to reioaaina trgn tne dtaoase to provide tne same image 



conditions "but without ah ^ accumulated er ror. . 
" Updating ot image memory can be controlled in various ways 
based upon adaptive determinations . pre-determination. or 



such as 



381 




attar rs - initial 1 z ationm ■ ,sucji 



Attier re-initial izing ot j ma ?<r memory, subsequent updating "^v aWj* 
inf.rn35cfi error accumui^ re- initialization may again 

used to iaound er ror accumulation" 
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ADDITIONAL FEATURES 
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Scenario-Related Detail. 




image 
area 



aft the range to the image is increased; "for . reduced detail anct greater 

petail can also fee contro lled as a tunction ot velocity and other 

parameters , as discussed belowT 

Increasing o r velocity can increase the rate that the image is scrolled. 
to be consistent w ith the incrMaed mo£ion7 increasing the scrolling rate can 
increase " the rate thatT the" cfalTabase memory is accessed to sup-po-- - 
increased scroll ing rafce. 'me latency time associated with pne~ 
memory can limi t maximum speed that ' canbe supported with this 
However, maximum speed can Ibe signit icant ly increased based upon 



this system. 



However, maximum speed can Tie significantly increased based upon using a 
speed variable detail implementation. ~j T~TZ -TTTTT \~ 

As relative speed increases, cne amount of . detail that. an observer can 
process decreases. For example, a low f lying„aircraf t at^high speed covers 
ground rapidly, but the ground appears as a gground rushSJ that reduces the 

gilofs ability to perceive details. Therefore^ it may n5t be. necessary, to 
rovide high detail information for conditions where vehicle, velocity 
, ^ _,r ^ -r — -, ^ - — " lonale can 



prevents perception of tfiese details. Implementation of such a rationa 
increase maxiifium scrolli ng velocity ofan image. For example, ffground 
can be implemented with a low detail image that" is interpolated, "such a 



rusi 



can be implemented with a low detail image that is interpolated, "such as wit 
s patial" p^Qcesgin g. in accordance with the discussions herein on storing o 
images having di fferent amounts ot compression and the discussions 
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exr 



image, with or without spatial filtering, can provide larger- images with 
fewer pixels. Such images can be scrolled w ith lower traffic from the 
database memory; permitting slower database memories and greater scrolling 
velocities , 

385 

Overlays , , , . . , , . 

, Overlays can include combinations of processed images and graphic 

polygons. For example, in a map display.- processed images can be used' tor 
backgrou nd terrain' and tor certain 'qbTeccs over laved thereon and graphic 
images can be used tor symbols and polygon images overlayed thereon. ~ 
- Overlays can be "implemented ifi_ various ways . images can be overlayed 
together in' the same image plan e ; where occulti ng is tuen t lxed and motion 
therebetween is then fixed Ima ges can, be overlayed in different planes ot 
the same rmage processo r .- where occulting is selectable, such in accordance 

no motion therebetween is 



the same image processor .- where occulting is sel ectable 7s 
with'occuftiiig priorities assigne d to ea ch plane, and motTo 
fixed, images "can be- overlayed in different planes ot 
processors .-'where occulting is "selectable, sucii i n accprdan 

Priorities assigned to each plan e and motion th erebetween is contruiiapiR 
Such as in accordance with independent image processors controlling ditterenT 
images, image overlays and graphic overlays can be mixed together .-' such as in 
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Overlays can include pictorial features, annotation symbols, imaginary 
ays I6r map diania^R. yi^ _°E ner , sucn L overlays^ - in a military 
:iays ca; ~ ~ 



:ion; overlays can 

navigatio n. Navigation jjatorma 




avigati 
, creaa- 
an inci 



radar 

if 



ercom 



reckon in' 



ensor 



Information can 



ude faaa 



er sensor 



lntormation 



387 




ies , on 

en irregular 



textured" images for nign detail interaction in real time: ~ " . ~ 
T extured overlays "ca n Ee cjoppea to lEeguIar external and internal 

features/ ~iTe.. a tr^e ha s -an external outline detinefl py the external leaf 
nd branch outlin e and lias internal spaces between leaves and Prancfres , 
extured overlaying can be performed to pixel resolution ana Pixel , Qepgil 
asga upon occulti ng priorities 7 j'nererore, "a tree image can Pe oriented^ 
ositioned. scaled? warned and over laved on a packground image; occulting the 



occulted tank image can he seen between the leaves r ot an occult ing tree image 
as it moves " behind the ' tree im age and can he seen as it moves past the 



moves "behind the tree image and can he seen as it moves pa 
ai outli ne of the "tree image . occulting can Pe pertormed 
^P^xeTljasis. so that ! a ! leaf 5r ■ brancfi can -occult a feature or a more 
obnect in one p ixel and an afljacenfc space between the leaves anc 

e same more remote object m 



external outline of tne. tree, image.. OCCUlt 11 

pixer-py -p?rxeTl?asis. so that a leaf or branch cai 
remote opt ect in one pixel and an acnacent sp 
Branches can display a non-occulted feature ot tnt 
an adjacent pixe"~ 



sm a 
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the present invent 
as be 



Graphic overlays can be implement ed in various forms with the system of 
invention. A graphic overla y can pe geometrically processed, such 
ntained in pixel words associated "with an ima'ge' that is Peing 



geometrically"" pfbcessed^or "such "as Peing containe 
Peing g raphic" overlay. Alternately, graph-- 



ed with an ima'ge' that is being 
itained m pixel words dedicatee 
; overlays can pe tixed. such as 



fic QV&- 

reial 
can Pe 



eriay. A lternately, graphic overlays can Pe fixed, such a 
ftive 1 " to the viewport . Tieomeyridai ly processed grapni 
rotated, translated, expanded^ compiregsed. warped, "an 



overlays can Pe rotated. translated, expanded^ compressed,,, warpefl, an 

otherwis e geometrically processed either "together with an image relate 
thereto or "separately, "independent ot other images. " ~ . 

Graphic overlays that are associated with .images and geometrically 
processed with such associated images will now be discussed. Graphic overlays 
can be written over an image in image memory to provide - — - 



Graphi; 
ntic""' — 1 



can be written over an image in image memory to provide a p ermana ent ove rlay 
Such permanent overlays haye Peen demonstrate^ with the BASIC PROGRAM LISTING 
LD.ASC Basic provided herein by loading graphic vectors, rectangles, and. test 
patterns and py loading textured image test, patterns over an image in image 




memory 



change the overlay 



convenient changes 

the pixe l wordsT^. ^ -.^ „„„ , — 

information: where Pgth. the previous image and the graphic overlay are 
stored separately in the pixel words selection logic can pe used to select 

lay inte nsity is stored in the pixel 



he graphic overlay it an overlay 
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word for overlaying the image and to select the image if a graphic overlay 
intensity is not stored in Che pixel word. Overlay Pits in a pixel that are 
all o- set can Pe indicative of a" condition where a" graphic overlay intensity 



a condition where a graphic overlay" lht 

qrd_. casuing the image " bits to Pe displayed 
;l that are hot all 0-set can be indicaf -- - 



is not stored in the pixel wq r 



Graphic overlay Pits in a pixe 



ive of 



a" condition "where" V gr¥phic^ovgrlay"is"stored in the pixel' word, causing the 

graphic overlay in tnaf pixei to pe displayed in pi"" ~~ ~— — -- 

Ok -bate can perused to detect non-zero overlay Pits 



the image Pits. An 
tne overlay 



pitS i tor seiecti 



or tor seTectihg the linage bits in response- 1 to non-zero overlay bits of^Tn 
response to zero overlay -pits . respectively. ~ ~ . ~~T 

Graphic overlays that are independent qf textured images and that are 
processea independently of other images will now be discussed. Graphic 
overlays can be written into a separate graphic image memory. This graphi- 



_ Cc— , T . 

image can be geo metrical 



5 



r~o ce s i s |& r^a^' di scu s¥ed J^r^ proce s s 1 ng ~ of" t exf u r e 



images in ^lma^e memo 




ay. can "be over 




processing of textured images herein. . 

Graphic overlays thatTare fixed in the viewport will now be discussed. 
Graphic Sverlays cafi be written into a separate graphic image memory. These 
graphic overlays can be reference d to th e vewip ort "and can be fixed to the 



viewport ■• gugh as with a viewport frame, alphanumeric characters, and Qthgr 
features that are to rema i n stationary in the viewport. This tixed graphic 

390 





i mpression. and expansipn .image 

LTarly Be s nannea - du t . swi t chirig 
implemented as follows . Presence 



^. - 3- featu re to be overiayed on the background image can be 

.ietectecl witn J various tecnni Ws rsu^ iffj^I 
memnry can nave zero intensify for pixels that do not have overlay image 



2d below. The overlay 
do not have overlap 
to ' Be "proviaed~ErTerein 
word and' can r>e be u 
l ternate J y an ove rl a- 



usee 



8 



Lternately. an overlay code 
lxeiF cari pe used only tor 
can use other codes except 



pixels, where overlaying of pixels^ can use other codes except 

wco de. The overlay image can be selected it an overlay image 

teature is nod in that "pixel and the^ b ackground image is selected: it an 
overlay is in that pi.xel. We s elected image can 



mi 
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he routed through the DACs to the display monitor . . . 

fiver lay images, "exemplary" ot" multiple combined images, can , be 




configuration, one 'arrangement is to replicate the image processing portions 
ot the system, (i.e., BL1, BM1. and ^M2) f.or generating a plurality of 
parallel RGB video signals from the different image processing channels . .EacJa 
channel can be assigned a differen t occulting priority. The Background image 
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refresh memory configuration permits loading in background and overlay 

information. simuItaneously.'A cfouble butter "ret resh memory configuration 
permits loading ot one retresn memory while ret resning a display with another 
refresh " 



retresn memory. 

An image J to be overiayed on a background need not be a regular shaped 
image, suchas a rectangular image: bub; may be an irregular shaped image, 
^ucri as an aircraft" or^ tree image, it may be desireaoie to overlay "an 
irregular image on a bac kground image . including tne textured pixels within 
the irregular outline T. and without -overlaying the pixels from the overlay 
memory m ap outside of the irregular image on the background image, one 
configuration tor overlaying ot Pixels within an irregular outline cma not 



overlayi ng or tnat image'honai stent witn nr.pnir.ina priorities 
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Overlaying will now be discussed for the color detection implementation. 
A null color, such as bl ack, can be loaded into the overlay memory and the 



image can bfi overlayRd thereon. Hence. Pixels outside qf the ^mage 
null color c nciR . sucn as b la cK . . An " inside ^ ffifl^fcon can be 
?cf by a l null color rnrie in a nixsi wora. Also, an outside condition 



a an image feature on . the outline ana inside qe Sge . Pwi^ne.^ABg. an 
TTer.orifligion^can be identify bv l- setting a flag in each pixel wo rd 
man is outside ot the " outline . A s the pixel words are scanned out to . the 
combining logic, detection or a Q-set pixel flag is. indicative qf a pixel 
that is to overlay the background image and a 1-set pixel flag is indicative 
of a pixel that is not to overlay the background, in this manner, overlaying 
images of both regular a n d irregular shape in an overlay memory can be 
overlayed onto a background imager 
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:ombining circuit can b e a series of tristate multiplexers for 
. such ^ as 73LS A gK ' mul t lp Jexer \ circuiCs . t or ~ se feet ing the 
i pixel from a plurality o£ pixel s trom tne plurality ot channels? 



The comb 
overlaying 
' pro pria f 




irmation to be ovenayea nave a u- set t lac 

— , - „ r 7 - - , overlaying image memories that do not contaii 

information to be overlayed nave a l-set Pixel flag? ~ 7. ~ 
For convenience of discussion, an implementation may be discussed 
relative to overlaying of an overlay image on a background image. However, 
this is intended to be illustrati ve of overlaying of a plurality of images 
therebetween and on a "background image. For" example, priorities can be 
identified such" as" with a priority 'register identifying the occulting 



such as with a " priority 'register identifying the occulting 
priorities of the diffe rent overlay- images it every one ot tne overlay 
images tor a parFicular pixel has Tnat pixel cropped, tnen tne background 
Having tne lowest occulting priority will be : 
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displayed for that pixel position . If every one of the overlay images except 



displayed tor tnat pixel position , it every one ot tne overlay images except , ... 
tgr one overlay image for a particular pixel has the image cropped; tnen the 
single overlay image that is no t cropped will be displayed, occulting tne 
Background image Frir tnat pixel position, it more than one or tne overlay 
images tor a par ticular pixel are not cropped, tnen tne one ot tne overlay 
images having the greatest occulting priority will nave tnat pixel displayed: 
occulting the background and other non- cropped images and not being occulted 



occulting the ba ckground and other non- cropped images and hot being occult e 
by higher priority cropped images tor that' pixel.' ~ ~ 

It'may Be desired to nave a rel atively large background image, such. as 
51 2 -hy-.si? pixels nr 1024 -by- 1024 pixels . and relatively smaJ L 'overlaying 

^- ^„ i-.- ^ - — -™ ~" rn " — — '-' — d is to 

pixels . 
are 



significantly smaller " Never Eneless7 TFTmay be advantageous to have address 
" " ^ that operate over the full " " 

_ _ __ , 

the" dverray _ "image _ address g~e7ne^at76rs. _ cah _ process" tne full region ^of the 



viewport, such as^ 512 -by- 5 12 "pixels . This can be achieved by i mplementing the 
address generators to cover the full image memory space, such as with overlay 
address generators havin g the same range as the" background image address 



generators ; but only 

c 
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populating the overlay i mage me mories wi th a small portion of the address 
decode ancf HAM chips or! tne full range or the address generators . Thi s small 
portion can be a portion large enough to store the overlay image, which may 
be significantly small er than t he ba ckground image. The overlay address 
generators can scangut a full i mage over "the range of the background image. 
most of which may address pixel positions tnat are not populated: The detaQlt 
condition tor a non- implemented pixel can be configured' to be the same as for 
a non- overlay f lag, such as a i-tiag. For example, a non-populated memory 
position can be represented by an open ci rcuit. Therefore, pui'l-up resistors 
on output lines will automatical ly generate a l-flag tor .a non-populated 
memory condition, indicative of a non-overlay flag and indicative of a 



cropped portion of the image. In this manner, relative ly small dimension 
imagfe me n tories can be used for relatively small oyeri ay images j to ' ~5e 
su perimposed on a relatively l arge oa cKgrouna image , ff fggg^ng 83.mpA^C3J aL-^ 



_ .ementa tion of a plurality ot address generators rSlaEe M ^^^r, 
qveflayable image s^ Haying' dimensions consistent JiQl — LOS — PacKgroimq 
dimensions tor s fm piicity gt registration and overiaving~ 777 
^" Each ot a pTuraTiW oT oVeWays can be ^ ma nipipTateq in accordance with 

^riina atiou^ a [ cente r coordinate: "and determining the initial 
^ast-pr scan tneretrpm. 5acfi of the overlaying images can Pe 



;o, a plurality of 
the background 



the sing le image 



compres%ing7e^^n^ and determining the in it i; 

point lor the ^raster scan there 'tram. Bacfi of "the ove"r 1 ay iW i mages can be 
rotated/: translated, .anff e^ to ^M^ ^.7^^'Yf I^PP jff 

therebetween T and relative t o "the ~ DacJcgr^ lndepenaent Of each Other 



motion 
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e in combination with a 

round image" priority is implicit in tne overlay, where an overlay flag 
or overlay color in a pixel wor<J commands ov.erlaymg of .the overlay image on 
the background image, in a configuration having a plurality of overlay images 
in combination witfh a background image . _ priority between tne overlay images 



e . pridgTty between the overlay lma 
ucn F ag t o provide control ot oeduTT 



can r>e establishe d in various ways 



ng. 



therebetween 



n a 



can be implemi 



tag controlled occulting configuration, a plurality of flag bits 
lamented tor each pixel wo rd to encode priorities between overlaysT 
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a background image pixel. 

in a, wire.- - 



d priority configuration, hardwiring selects channel priorities 
;petweep by wiring channels to input boards, with selection of 



relative tnerefc^ ween l riy wiring'cnanneis to input t 
-jumpers, and with other" wiring' techniques ■ ~\ 

in a programmabl e priority cont figuration, 
ties relative therebetween jg performed Joy a — 



selection q£ , cha nn e l 

iJple priority wor5 
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can be implement . 




LD.ASC provid _ 

imagq and tne overlays 

irregulars 
rotating a cropped 1 



precise tray it ions between ^the ^overlay;ing 



tne over I ay efi "image without a Fictitious border etfg 
on permits" indi vidual cropping ot an image, such as 
gha pfed" image:" coTT^re"ssin g" ^ cro pped im age" to a desii 
cropped image to tne desired orie ntation and translating 



braer , et sect, 



AS 



,„ .„„„ „ ™ _ WJ^th ah 

compressing ^ cropped image; to a desired size .- 
to tne desired orientation and translating a cropped 



, opped lm, ^ , 

image to the desired position. Continuou s rotation, compression, expans ion, 
and" translation can be controlled: such as with operator -tOYStiCK comm ands 
and computer commands.- to provide continuous_ dynamic cropped pven ays moving 
relative to each other and relative to the' packgrouncr. Also, continuous 



cro pping nan be provided, s uch by changing the flag or color structure of the 
overlay" images, ~~ . , , . ... , , . , . . 

Kjr ----- ~ — - — ^--^ v -- enabling and disabling 



"B ynamifi image effec ts can be provided by enabling — an 

overlays: mien as under op erator or computer control . t or exampn 
nerson image can be implemented with a" Plurality ot ditterent H 



e. a running 



person image can be imp lement ed with a pluralilv of ditterent images . where 
pa imags is in a fiif f sreE sYate ot a sequence ot running motions. 
selecting' a sequence ot 
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combine 



messing . For example oir rerent images can ne aricnmeticaiiv 
^ally ^co mbined; "and otherwise combined in addition to , 
hmetic combination includes adding, subtracting. multiPiyingT 
ner arith metically combining lnterisi ties. Logical combination 
. ORincr. XoKing.- 1 Afto/OKing. and other logically combining 



overpaying 

givi--~- 




^^^^^ circuits; such as a single set ol . . 

tipiier" divider, and logical ar rangements Each pixel can have a single 
octiromahc intensity or a plurality of color intensities. for a 



ler. subtracter. 

' 1£ 



myj 



monochromatic 



plurality o. 

e" channel ot 




401 



Overlays can be dynamically movin g video images, such as real time video 
>s from a vide ic ~ camera or video disk, and need not be limited to static 



imagi 



:rames oi 



are superim posed^ in seguence 



overlay p rT a vid¥o Jisjc showing a full running cycle that 

£ implemented as , selection ,_an.d replacement- , &s 



overlaying mav 

3usly discus sea 1 . 
caicion. For, e; 



emented as , selection , and replacement ■ as 

for'some applications it may be" desireabie to 
two ot the overlay planes can be used as tuii 
:hese two planes "can be selected to add or to 



previoi 
~e a- 



However' 



subtract! 



planes a nd operation 



or exatmole. 



ween 



each other to 




ese two 



•lay planes can be used as tu 
eg- can be selected to add or 



HtPUt 
lae t 



being 



rop 



interna] 



outline as we 

le above, overlaying 



ty nags can Toe set and res 
li as external to an lrrecnil; 

roach 



irregular outline 



crop 



.rregular 



ermits progressive spatial fading- in and 

"Ttaffg of overlay tl 



fadirig^ut ot image's , ~ FOf exampTe."'" ~s~et°tirig ~ot~ bveYlay"" tlags"" , permit 1 s 
dynamica lly spatially tadmg- ' 



• m . 
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Multiple textured i m age s can be superimposed -i or overlayed on the. 

around image us ing image processing t.ecnniques discussed herein. For 



bacKgroung image .using, , image processing cecnn] 
example, in an aircraft navigational simulatioi 



es discussed herein . For 

a terr ain image can be 




processing ot the aircra ft image can be' sepera 
the background image to proyide relative ettec 



^ . . „ M „ „ - JKgrpunc 

ana tne aircraft -image: -me aircratt image can tnen be overiayeq on the 
background image to provide relative mot ion therebetween . The'retore. In 
observer can view the aircratt image moving relative to the 



\ge moving 
tne bac*5 



e ftacKground igage 



where both the aircratt image and 
be moving relative to each 'other 

Overlaying^ ot ditterent images can be penonnea in various ways une 
arrangeme nt 'writes the overlaying image into the corresponding pixels' ot the 
- - riayed image tor a composite overlaying and overlayed 'image. Ano ther 
ang^ment maintains the " overlaying image ana tne overlayed image m 
arate image memories and switching between tne ditterent image memories as 
unction ot the ranges ot tne images (where range can establish occulting 
orities) to or.cmr.-r.ne more remote overiaved images with the less remote 



e background image can be moving ana can 

can be performed in various ways One 
- ..^ . Pixels' ot th 



overia 



arrang 



separate image memories and_ switchi 



riorities) to occu 



e more remote overlayed images with the less remote 



veriaying images 
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lower arm, and hand move . ___ 

relative to the shoulder and, as the upper arm moves . tHe" 



move accor di ngly, i n addition, the lower arm can move relative to the upper 
aVandrasT-hVTower arm move s , t he hand moves" ¥cCQ ^inqIvT in aaaition, £ng 
hand can move i relative to tne upper" ar m ana ohiects herd in the hand move 
^^^1'^ w i t h a n action g a me navin o r a 



accordingly . sucn action can be iilustrateiL_wjri _ 

1?^^^^^^^^^^^^ g a me with an arm will now be discussed 
with re ^ ssn^ .^IJrYS s -. JOTFi^ , a ™ ■ 



lower at 



mn/ swore 



F.o ' shoulde r OA cTriv es l ower arm ga UK ^p^U ^L^^t^^ 
lower -arm 520> "r e lative to upper arm 82UC etriyes nana/swpra 
motlon^Qt . hand/ fwora^ H2w7tf ^gQan'be pygySea^elat fre to" 
Each ot these elements; snouiaer B 21) A, upper arm 82l)(J. lowe 



■uc relative 



motion of hand,/ sword 82CX-t/Hzuh can ne provided relative co lowei dxiii o^uc 
Each V ot V Ehese_e!emen hsr s^ 

hand / sword -"^Ofe/gifojf; ' can ne impietnenY#ci in . separate amage 

memories^" EacTro^ 

r otation, wnicn is the sp miifler noint point qt rotation 82UB tor upper arm 
H2Qfl. the ellyw p q.inr nf v rpfA6nl^uB"tQr Tower armlM, ana tne wriSE 
point: or r&ffiiorf\2ffi Tor • jiancT 820Tf . Bach element" In ibs sepa rate image 

memory: c an tie i rotated about the Point Ot 
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rotatic 



ion. The elements can th en he connected together by overlaying each 
yient element; in a manner that connect s_ tfie^po_int_ ojt jrotat ion , in _ the 



subse 



C 

. , :o the corresp onding point ot rotation in tne 

f pr example, upper arm 820C can be oyeriaved on should 
that "places shoulder i pint point ot rota 
for tfotn . shoulder 8 Joa afid~ upper arm 



r^Ving "element! 



can Re" over l ayed on shoulder 82UA m a manner 
r.i.6n w H20B at the same image position 
»20c Al so. lower arm" H2 Pit can be 
that places tne elbow point o~ 



icer uzva and" u pper arm a^ui:. aisd. — mwg£ flfrHH.g^Vft WH vg 
p per arm X2(R1 iif a manner that' places fene elpow point ot 
f J the "same image position tor aotn". lower arm 82UK and upper 
hang . hZlCxA can bg 5ver laved on lower arm 82uK in a manner that 
-point of rotat i o n at the "same image position tor both? 

htf lower arm kAoWT ~ . ~ ~ ~ " 

ntlhe corresp onding point of rotation for two elements can 
identitvincr tHe r pixeI 3 tftaE corresponds to £he common point of 



rotatj.1 



arm H20C. Also, hand H2QG can 



,acej 



Una. 



2QG and the" lower arm 820E 
iver laying ot the corresponding poi 
— _ -yided -*py identity ing the" pixel that 
rotation tor J Poth eie'ments tne driving 
r He drivi ng element moves . tne point ot r( 
■able to Keep fcracic ot the point ol 



be _ provide; 



tying tne~ pixel t Tiat corresponds to the common point of 
efnents". "toe T driving element! and the driven eiementTAs 
loves . trie Tpoint ot rotation moves correspondingly, it is 
rack ojttfe T point of jotahon as it moves. This canbe 
ways, dne way is to identity tne point ot rotation with 
fin a tTao field "ot .the" Pixel word , Another way isto 
"tion ot trie poin t "or rotation trom the old position ot 
n and the amount ot motion. ~ " . ~ 

t can be over Laved on a driving element, i.e. hand 820G 



I 



esirea 



S 



achieved m various ways 
a unique code stored - 
compufie the new posit: 



the point ot rotation and the r amount of motion. ~ ~ . , , ____ 

A driven element can be overlayed on a driving element, i.e. hand 82QG 

can be overTayed gn"^ hand 82UG so that the wrist 
point ot rotation 82UF of the hand image 
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overlays the wrist point of rotation for the lower arm 820E AS discussed 
above/t his can be achieved by identifying the pixel m which the point ot 
rotation ot the dr iving element' with an x~and ~ST "po^Bitiorr"ana"then translating 
the driven eleme nt so' that the point ot rotation ot t-he driven^ elemental 



Lon of the driving element with an x and Y posit ii 
riven element so that the point ot rotation ot 
ayed, on the same x and Y "position ot the poi 



•he driven element 
point ot rotation ot 



Sal 



irxving element, . 

Tne" alipve relative motion of attached glementL 
ot the e lements. FQr example . translation anc 



facilitates comp 
t^on ot sno r - 




-ion of the elements. For example 

J A c orr e spondingl y t ran si a t e s ahd 
l hand _ JQOG ■• tr ans l at iqn and r" 

dingl 



•qtates upper arm 15 



mm 

rm 82 5g 



wer a 



atiy 



IQA corre spondingly translates 
translation and' rotation, ot .1 



otation M. 



and rota' 




arm BfuFaM 



Uder 



cor re spqnciingl 



r . .. ion, o 

■ransiates and 



^ qwer arm 
ot a te s n l m a 



ative^to. 
f^A^nd 



upper arm 
motion of 



upper arm 



lation 




nafclori of 



motion of 



on Qt 



upper arm 



ion, ol 



motion of 



motion, o 



ower. 



motion or shoulder wz\ 
' motion ot J 



_an 



S 



upper ar ms: 



"825G'Ts^ 



a, cl 

motion ot lower arm 



matio 



land h: 



motion d 
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General Description . „ . . 

Various applications of the present invention. mvolye scrolling over a 
large image, such as a large area of terrain. This invention is well adapted 
for^scroIling_ ov er a large database i^maqe using a "virtual scrolling" 



. . . .database mempry 

implemented with available^ 
memories tor a large image database, is 
The database arrangements 



cge da 

for storinc 



image using 

i large da t aba 



a large database imag 

■ 'isk memories. A review o 

rovided below. , 

hereip qan include 



scrolling 1 
can be readily 



memories, such as'disk memories 
ige database, is provided b.el 
arrangements ,disclos& 



disl 



The database arrangements discldsed herein can 3J 

management capability, such as with a relational database c 
database." tdr^ convenie ntly accessing information tor 



a memp 



or an associa 



-— terhately. the memory man^agement cap a. search cap — ^_ 

tor locating particurar infor mation within the database, other" memory 

management approaches can be used. TTT . . . . , ~ . : 

Two generic types or very i^arge database memgries are available, digital 
disk memories and analog disk memories. Digital disk memories are 



IS 



.gpgga 



ive a sear 



capabi 



characterized by Winchester da,sk memories. Analog, disk memories are 
characterized by optical video disk memories. Video dfisk memories have the 
lpwest cost potential .and greatest storage capacity, potential. Large 
Winchester disks are readily available at an affordable price, are relatively 
easy to interface to, and have acceptable^ .accesg rates. Therefore, large 
Winchester disks can be used for current configurations and optical disks can 
be used for longer range requirements, however, datapase memory can be 
implemented with any of the memory types discussed herein. 
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Larqe rotating memories exceeding 1 -gigabyte capacity are currently 
available. Winchester disk memories, exceeding 100 -megabyte capacity are 
readily available at low cost. Assuming 1-byte. per pixel linage color capa- 
bility, as provided m the experimental . system discussed herein; .an image can 
be provided having 10, 000-pixfels on a side with 3 100-megabyte disk. Assuming 
a terrain resolution of Z-meters per pixel, this ^elates to a 20-kilometer 
square environment capability with, a ICR) -megabyte disk memory. Use of larger 
disk memories, use or n\ultiple .disk memories ,m parallel, and use of image 
compression, permits this capacity to be significantly increase?. 

Images^ can be implemented is different .wayj5., SUC& as by S ^Qg^mg &n JUBag^ 



or by constructing an image rrom imacre 1 
world sc ene tRa& must accurately represent 
image aetaiis can be stored in tne datab 
the . real world e nvironment. Also . tor see 



constructing an image trom imacre primitive. For example! 
that must accuratel " ' — " " *~ 



a "real "world roca^ioh, the "actuaT 



or a rea 
:ne act 



e stored "in tng L database and can jpe apcesst 
environme nt. Also, tor scenes that nee 

n be 



world 'location. 



accessed "agQjoy^ 



ae store 



image primitives car 



ages 



in 



and non- compressed image StQra 



aEapase" in comp ressed or in non- compressed 



form. stdfacre in compressed torm reduces the memory r requirements _and involves 
de- compression to restore the image. Storage in non- compressed form requires 
greater storage capacity, but, does not need de- compress ion. For exgmple. 
comp ressed image storage can be used for applications having signiticant 
)ase cons traints, sucti as avionic applications. 
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can 



ffe 
jag_ 



used for applications, without 

as gro und- " Pased simulation 



s^gn^ticant 

applicatJiQns , rsn^aj.^ ., ^iiiy^mw 

forage can benefit trom spa 
_ , [1 reso j_ T - j -- — -— 



abase 
mages 



constrai 
implement 



:s , sue 
t uteri 



er comp ressed or" non- compressed 
— — -Jj^-- 



cement capability 
— — 



increase spatial resolution 'am 



tor anti-aliasing 
in non- real " 



o increase co3 



or smootnness an 



non- real world applications, an unlimited amount of terrain can be 
Fed wjTEft a reTatfffeTys^ overlaying 
primitives stored in the database Trie primitives can include 
" terrain, deser t terrain, nuiy terrain: mountainous terrain? 
ultural t ear.ures. graphics, aipnanumerics .- icons . and other sucfl primitives? 
------ r primitives- caft Te comffine d to rorm a virtually uniimibefl numper of 



construe 



:errain 



ores ted 



$rra i 



s imui a tea envi r o nm en 



an be 

its tp ,cp: ^ 
Lt of daEabas 



Sfc 



relative 



■lavma Backgroun 



construct enormous areas' o 



memory capac iEv . ~Te r r ain ima 



errain wj, 



ove-riayegi teatures ana^de^'ails ; 

prown nacjcarounti having toiiage overlays 



an be 



constructed Py ove 
such as a varying 



tex^i 



color. 



ured green a 



'overlays to coSst; rue? a T simul>lfedT scene 
ase memory tor an image processing system can be 1 

haying a storea image, xnr "~ ~ 



am 



tura 



Wl 



image . . 

memory device; 



map can 



. ing a sITor 

^ — ^. ^r oEner such memory aevic ^ 

loading ot new intormation, sucn as over a .data link, from a remot 



memory map 
,_A . RAM mem 



memory map 




ed w 



8 




A ROlVj memo ry ma 
)lug-m cartridge 



s tne 

f . t _ __ database. 

provides nori-yolatile images which "can be. changed with 



plug- in .cartridges "As shown in Fig 2B. memory^ map 2Q5B can be implemented to 
be larger than Window 205A: where window "a USA 
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system 



provi 



syst 
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Database Memory Implementation? 

Database memories can be implemented m various forms . These forms can 
bg characterised as rot ating meifories and ^ memories, analog and 

digital memories . magnetic 'and non-magnetic memories, and other forms ot 
Many types ot database memories have been described. For example 



ligital memories. 
memories . M any 
magnetic disk an 
charged coupled device 



Qptical 

.{CCD 



lsk memories have been described herein and 
and bubble memories have _ beei>__ described in 



patent applications S/N 520,277; S/N 889,301; S/N 844,765; S/N 812,285; and 
other patent applications, referenced therein and patents issuing thereon. 




torage per dis. 
anutactured by 



m^nu 
digit 



tne digi tal magnetic disic memory 



, ill 10ns 'OJ 

1 py Ampex , Kennedy , Ful itsu, 
e t^c dru m memory can be u - 



M7 aM^ouier companies' 
re database memory^ 



. as, axK .xmage _ . .„„ 

e digita l magnetic drum memor y can 



as wit 



provide large cap 



manu 




magnetic tape 
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lorycan^ implemented in t he form of a cassette, a reel, an endless lOOP, 

° fln^anafog magnetic disk m e mory, can be used as an image database memory . 
naing &Ptic T j fisk m^emory can provide large capacity storage^ 
An aflafoff magnet i c &ape memory can pe~usid gs an image gatapase memory, 
naloq magnetic lape lemo^ cln proviae large capacity storage, such, as 



memo 
OX 

The analo 



The analog magnetic tape memory can provide large capacity storage, sucn as 
hundreds t>f millions of bytes of stdrage per tape. An analog magnetic taps 
memory can be imp lemented in the form of a cassette, a reel, an endless 1QQP, 

or ot^ er^tgrgL. optic al disk memory , such ^ s a video disk memory, can, be, used 



capacity storageT such as billions of; Bytes of storage per optical .disk. Such 
disk metapries are manufactured by Pioneer, RCA, and other companies. 

a digital optical disk memor y ca n be used as an ima ge database memory. 
The digital optical disk memory 1 can provide lame capacity storage, sucn as 
hundreds of Trillions of bytes of storage per disk to billions of bytes of 
stO£*cicr6 lDGjr disk 

% digital ccp alterable m emor y can be used as an ima ge dat a base memory. 
The digital CCD alterable memory can provide large capacity storage, sucn as 
hundreds of millions of bytes of storage oer memory. Such v£D alterable mem- 
ories were manufactured. By Intel and othfer companies. Digital CCD alterable 
memories are desc r ibed in the previously referenced patent applications? 
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An analog CCD alterable memor y can be used as an image database memory. 
The analog CCD alterable memory can provide large capacity storage, such as 
hundreds of millions of. bytes of storage per memory. Analog CCD alterable 
m emorie s are described m the previously re£ ere S c g d Kg§£ en ^^gP/ :; ^£ J 

A digital CyD ROM can be use d as an image database memory. The 



jD ROM can provide large capacity storage, sucn as nunareas or minions or 
bytes of storage per memory, Analog CCD ROMs are described m the previously 
referenced patent applications . . - 

A digital magnetic Taubbie memory can be used as an image database 
memoryTT he digital bubble memory can provide large capacity storage, such. as 
hundreds of millions of bytes of storage per memory.. S.udh bubble memories 
were manufactured by Intel, IBM, and other dbmpames . Digital bubble memories 
are described in the previously referenced patent applications^ Z~" 
£n~^Icg ^ memory^ The 

analog bubble T memory can provide large capacity storage, such as hundred? of 
millions of .bytes of storage oer memory. Analod' b ubble memories are described 
in the p reviously referenced patent applications? : 
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An analog film memory can be used as an image database memory^ The 
analog film memory can T provide J,arge capacity storage, such as hundreds of 
millions of bytes .6f stofage to billions bf byt.es of storage per memory. Such 
analog film memories are .manufactured, by Bendix and other companies. It , can 
be imp lemented by recording the map images on film, mechanically scrolling 
the riim. and scanning tne^tiim with a rlying spot scanner to convert txom 
QPtlC |l d tg i glgC^cal n image g; fgrm, ^ e database memory The digital RAM 
can provide large capacity storage, such as hundreds ot millions of bytes of 
storage per memory. Such RAMs were. manufactured by Intel, Texas, Instruments, 
Mitsubishi, and other companies. Digital RAMs are described in the previously 
referenc ed patent applications . . „ ,. , t , _ 

A digital KOm can be used as an image database memory. The digital ROM 
can provide large capacity storage, such as hundreds ot millions of bytes of 
storage per memory. Such ROMs are manufactured by Intel, Texas, Instruments . 
patent aonlTc^Pions . Dig:Lt ~- al RQMs are de scribed in the previously referenced 
pate n^ appli^a ti^ns fl ^ ^ -jmage database memory The digital PROM 

can provide large capacity storage, such as hundreds ot millions or bytes of 
storage per memory. Such PROMs are manufactured by Intel, Texas, Instruments, 
and other comp.ani.es. As discussed for RAMS. R Oj^ ^0I& fa e SQ tn€ 
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Ci ™ W fer jggl ' dl^SBagg S gi Sgy e igg£Sigaagg a ii^e|n individually descried. 



Sugh dat a base memory arrangements can be used in comt>Anat,lQn tQ pgQY3.de 
Mditionai advaffi an integrated arcin . t M Sag pgpy3,a€~a 

low cost non-vora^iie . monoli t hic data base T ntemoxy . Ifowever , A t do es" not pro- " 
vide the capability or c onv en ien t Imaging , Qt : updated int Q ^^o n. ^Qmg^n^ 
pr an r integrated " circuit fe^g. such "as tor Storage ot permanent terr^ 



vide the capability ot c onv en ien t loading Qt updated i nt Q ^^ on. uomg^n^ng 
gF an jnFeBea gircuit , sucF, as t o r Storage W ^^^enz H^f^fl 
infonfaf ffi i. in combination with an integrated circuil: a 1 te/abie memory. Bu ffi 
as For sTorage oT threat i ^ OS , a ROM tor 

perm anent lmfg^es^ana^ li ™*^? L /iftfrg, Eg.™^ 

loading ot threat lnto^rmalfip n prio r "to , a rnVsgion wlth^ tne ai terabie ; tiremo rgl 
overcoming anelectrical ^alterabilit y limitation Qt the r e ad-pnlymemory I^ 
^nyrappii^ cati Tops need" ruggedi zed systems; such as military applications 
and avindir^ppV rations. Jhe moving map display application di 5 cufesed herein 
is repre sentative The image jrdce^ 

■ %^nFea witli^e lience 3 i s" easily ■ fflqqe aigeg . mf 



r^lenfenfcea with el ec tronic J cir ^uTtj ' ana lience" is easily . ru gge disea . m a 
laf'ahase '"menpry m a y" not lie ^mplemehted with integrated circuits and nence may 
ie more" di t t icui t to rugqedileT ,. . ~ ~ ~ ~~~ ^TTTTTI 
Rotating memories , such as disk and drum memories, have delicate 
mechanical assemblies and. therefore are sensitive to shock, vibration, and 
Other environmental considerations. However, rotating memories have been 
implemented in rugged form , such as for avionic applications. Also, rotating 
memories . sucn ■ 
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as Winchester disk memories and optical disk memories, which are readily 
availabl e in no^ being ruqqeaizea Z 5E 

military and avionic "applications . ~ . , , , . 

T Magnetic Cape meWrie^T as with .rotating , memories, have delicate 

mechanical assemb lies and hence are sensitive to Shock, vibration, and Other 
environmental considerat ions, However, tape memories have been implemented m 
rugged "rorm: such as tor avionic application ^ Also, tape memories .such as 
cassette "tape memories . "wlicji are readily available m non-rugg ed 
configurations, are p resently being ruggedized tor military and avionic 

appli gat|:3 3 oj3|^ mem ories: such as RAM. ROM. PROM. CCD, and bubble memorie s,- 
provide 'rugged^ electronic circuit portions Qt t he 

system? Solid state memories often have lower capacity and greater cpst per 
Bit compared to rotating memories and tape memories . Im proved capacity and 
reduced cost is ob tained with the analog TCP memories and the analog bubble 
memories" described in the referenced patent applications. TheretoreTtrom !1 



memories described in the referenced patent applications. Therefore, from a 
cost and capaciTy sTandpoiiit/ analog solid state memories are the more 
advantageous theri the digital solid state memorie s. ~ . 

gle ctrlcai aiterabiiity is a desireabie" feature for database memories, 




a desireable feature tor data 

gitication ot the images. Database memories 
? may involve mech anical operations to change 
^he database: such as removing a nd "replacing a read only optical disk or "a 
sol id sTate ROM module ot the above described memories : electrically 
alterable memories include magnetic disks, magnetic drums. 
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magnetic tape RAMS, and alterable CCDS . Of the above described memories: 
non-"electrigally aiteraple memories include some types ot optical disks and 



Non-volatility is .a desireable feature for database memories, such , as 
for preserving stored, information during power turn-off. Database memories 
that; are volatile may include battery badk-up to preserve stored lntorm 
during power turn - ~pt t . or may require nop- lnterruptabie power source! 



purees . or 



heabove 



irums . 



?QVe 
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digital infor mation can be stored directly on an analog video disk For 
example , intorma p on i stored on a video di sic can be either in the l-state or 
the ft -state as ; digi hai "intormati on rather than in a continuously vanarlTe 
range ot analog mTormation. 
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a record of information on vi d eo d i s k can be id entified with a . digital 
siich as a preamble or Heaaer a^t tne b egimmg Qt , the r ^pV^. and can Se 
nated with a post amble "liav ing a digital code . For example, _ the _ header 



terminat ed with a posta 
may have a Barker code 
beginning of a record 



Q3_ 



le recorc 



post amble riavina a digital cod e O'or example, the header 
Hode or^otHer"uniquelY code to identity E Es 

:ord and can nave a a .P Q q^.',., .S^C^ 5 ^ 



ecords can 
discussion? 



rack 7 or (cT "is subsequent to tne 
r^pVn I nra f Prt , i t can "fie read ^s 
the v ideo disk can pe read until 

as been iq 

ternateTyT 



desir 



neede 



■Si 'track. It tne desired trac 
&1 it a prior track has been located, 



or to ti 



sire* 



has 



it has a dvance 
the head can 




ed track. If 

to ^he 



the video disk can 

issequeflt track^s^ 

backwards 



subsequent 
desirea Tra 



subs 



equent 
:k pre< 



,the . 

rack anc 



can be moved backwards to 
en can b e advanced to the 



)rior 
sired 



track- proceeding 



track as discussed above 
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corre 



rovide a 
re-read 



single frame capability . "where a single video track can be read and re-read 
repeatedly tc T display the same f rame on a video monitor Similarly, m a 
digital video disie configuration: the same digital information can loe read 
and re-read tor error correcti ng purposes. 
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Mosaic Storage Locations 
^ . The^ p articular featu] 
facilitate use of a video t 
mterac 



lar features of the. present ^mage processor^, inyentipn 

a video tape recorder ror a dat 
arcade games _ and_ lr 



1 



ase: such as "for dynamic 
S^mulatQr^" 



Zrl 
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i 8 -adjacent __ __ 

of th$ 87- ach aceht mosaic s stored on video tape from the mosaic in image 
memory . Similarly, when one of 8-adjacen t mosaics are accessed from video 
memory and, overlay ed into image mp.mr>ty. if. is desirable to nave easy access 
to all of tne 8-mosaics a djacent therpf.o stored in video memory from tnis new 
mosaic in image memory. For random access-type-database memories, such as 
isks; enhanced sequenti al acce ss is des ireariJe but has reduced importance" 
sequential access-type data base mem ories, such as video tape ; enhanced 
Uncial access is desireable and las increased importanc"e . Enhanced 



or segue 



sequ en t i al ac cess as 



sequential access can be providpf ^py gro uping of mosaics, in a mann 

coflsistent with t he motion through rhe environment in accordance with t 
virtual scrolling implementation.- 



access 



It become s apparent that the number of mosaics ffrorffi along a . .gegygnt^al 
a database iie^mory incre a se p£ tne gj. st ance 

from the ? ar'arC riixel. Thxs is a .unction ot tne square-law type ettect 



awav Trom Yhe "start pixel This Is a function of the square-law, type ettect 
ot the number or scenarios , where the motion from a .start mosaic San go to 
each of 8-adiacent mosaics, and then to each of 8 .-adjacent mosaics for each 
of those, and so forth. Hence, th e tape very, rapid! y fills up close to the 
start mosaic. Therefore, it mav Pe desireaPle to detme directions anQ__t_o 
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proceeds further in depth into 4-guadrants. A high Speed . tape jWiM. operation 
nan v he T performed to cfe" to a ratge r remote l ocation" on tne tape to PICK UP 
s;bse g ulriOQs^ ,qi r^xpn_._ , _~ ^, ^ ctic Z7 ^ _ 



ens: 




The . tape is e 



^^^eiy^i-'d3^hfi±on&l . The additional directions of 
cart he provided Igy having relatively, wif 



ional memory map cart be provided by having relatively ^^XY .space 
ft mosaics. J e_Fect -veiy -lviaing the taper into a muiti-aimens^ona 



mosaic 



ne feature is to p . lace redundant mosaics ^n . the tape tp reduce search 
s. For example ~_ it : tne pI ubT ai^ plus-Y direction (first quadrant) 
:s are groupfea^fcoggtfier 5E seperate 'T ocat ions on tne tape 7 ghere "are 



1 




'and ad f agent thereto separating .these 



mosaics al 



ritfh^irectTid^s ofmoHon. Rather 
between 5 -block s ot mosaics as 



2 -direct ions tha 



response to geometric processing: such as m response to translatip 
translates t6ward s tne'eflge ot the mosaics in image memory ana such 
response to comp ression tn'at compresses tne mosaics in image memory^ 
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mosaic 



jxami 



mosaic 



) anq- ea^ 



mosaic can 



parti 
i"cs ti 



into an array 



[___ 

genera 



pixel s oy - b 12 -pixels . Accessing 
rally Pe -accessing ot adiacent im 
osaics J 27~ ~ 28 . is. and _£ dan be s : 



ofi mosai 
>saics , For exam; 



rom ctataPase memory "will 
mple, as shown in Fig 7A; 
mory: where translation 
--d J _v and transiat: ~ 



E 



XXX 1 



rmosaTcV and 3 7 ana translation 
19 and 20 . Consequently , accessing of 
in a -dimensional environment . 



o tne right can mvpivg accessing ot mosai 
v Rwara "c an involve accessing of mosaicr n " — 1 
• a&]acenfc_mosaics_ can involve acc^ssin 

a__d 



memory 
mosaics 



icent mosaics can involve accessing in a 2 -dimensional enviro; 

Database memories may t >e implemented m 1-dimensional form. F 
lgital magnetic Tape m emory may store pixels sequentially 

„ ----- -zc-- - t ~ -gtore a dataioa" — 

ntially to store a qLataio 



mosaic and may store mosaics sequent la 
. -^■---^ — ^ m - saics s g quent 

___, Winchester d 

sequentially on ^ trac: 



or example, 
to st ofe a 



„ . ^ , ^ ^ J?ase image. A_Yi3eg 

tape memory may store mosaics se quent lalTy^to store a database image, A di 
-.^-^ _ _ ^isk memory or a. vidr~ 



sk 



a t rack 

ifc ot she 



LRk memory or a video disk memory, ' may store 
ar>d may sequentially access different tracks . 



Therefore, "an arrangement of storing "a 2 -dimension^ ot mosaics with a 

sequential or a 1 -dimens ional DataBase can be advantageous. , , 

An arrangement for storing ,a 2 -dimensional array of mosaics in a 
1-dimensional or sequential form is phown. in Figs lh and 7B. The database 
memory; can be organized to stor e 1 -dimensional groupings of mosaics m one 



dire^ ot" "m emory" ancTVo "store" l" dimensional mosaics in 
the other direction in i adjacent mosaic locations. For example, norizontallv 



aaa: 
ad 



adjacent 
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mosaics 1 to 8 in the 2-dimensional array (Fig 7A) can be stored as adiacent 
mosaics i n the l- dimensional memory J Pifr IB). Vertically adiacent groupings 
of mosaics ; i.e., mosaic grouping y to 8 and mosaic grouping 9 . tp 16 ; can Be 
stored as adjacent groupings of adjacent mosaics; i.e.. sequen.tial mosaics 1, 
2, 3., 4, 5,6, 7,. 8, T.0, , .11, J 12 , 13, 14, .15, and 16* ^Fig^B) . In this 



conf iguratigr 
mosaics and 



o database adiacen 



mosaics stored 
For exampi« 



mosaics st 



_ , arrangement sTipwnrin Figs 7A.and"7B having a square 

8 -mosaics by 8 -mosaic image stored in a 1- dimensional databa.se memory; 
horizontally adjacent image mosajLc s are stored in database memory g.n adiacent 



locations and vertically"adiacen^ image mosaics are stored in dataPase memory 
_____ ^. or e locatiolis away. consequently. such a scr ^^ 
jfement can "tie stored in database memory wittf a maximum sea; 



dataP. 



irran 



or"a-_y"adyacent mosaic" Be ing a square roo t type tunc t ion ot the total numPer 



__L 



_quentiy, 
type tun 



an 



1 stance 



mag? 



ot mosaics i o T the image , ^_ ^ , nr , 

For example, in xhe arrangement shown i,n Fi.gs 7A an4 7B, the maximum 
search distance for vertically adjacent mosaics is 8 -mosaics; which is the 



square root of the quantity of 64 -mosaics in the linage. Also,,, f or an, example 
of i-biliion pixels in database memory partinio ned as : »V-^sa"a eScS 
Raving m^pi^lB by 5i>-m. xe is; tn e .^Ijo -mosaics c an . PftJ^y^^QneQ in an 
array 3 orfe1)-mo^ ana consequently win nave a maximum s earcn 

distance nt Tu-mo saids Iths square root ot 36UUT. 
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similarly, aspect ratios ot her t han square aspect ^noR cap be , cpB^gyred 
where lor example tnegbpv e ^JbW- ^ .?. < ^ t ^.?M^f £.. a „ 

100 -mosaics i Tor TiqrizontaT adiacencv and JF- mosa ics tor ye rticaf aai a gency 
w^h vertically acjiacent mosaics ^'being stored in ^acJn agent loca tions l!L_Lia£ 



as 



- IB 

i-dimehs ldhal~fratabase memory ar 

stored 3 6 -mosaic locations apart.. . ^^^^ ~ 

Xr-^s sing or. a mosai c caii be' achieved by identifying the address Of the 
storage locaYfonf or the mosaicT For simplicity or discussion, £fie_ addresses 
g f p *ffl! mp**^ j# a J!-aimensio n al databa se . memory will . ^ e ~ Numbered 
e ^igntiairy TFig 7fe) . Tne_ i-dime ns i pna j. mosaic agdresses ca n pg map pea into 
- -^ - r ia ics having sequentially aggressed mosaics in 

aying non-seq i]en^ially addressed mosaics in the 



s heing stored in adn agent locations ' in thS 
nd with horizonta lly afliar.ent mosaics being 



se quent laixy (Fig 7p) . The, . i-gimensipnai mosaic aqaresses can g| mapgeq inyq 
gfc g^ai^K e rfeionjfl image ot "mosaics having sequent lailv aggresseg mosaics 35 
rizonVal direcbion ana having non-se^enVianv r aoftresseg mosaics in t Ef 
i ndirection ( f xh Ik ) . "M osaic ad dresses can"Fe derive d invaxiou s: 
Tor f-xample. addresses ot adj acenT mosaics can be calculated or can be 
• Addresses of adjacent mosaics can be i . stored with the current mos ajLC; 
a nirrpnP mnsai F7 J mnRain-2fl7 can store the address tor horizontal ngnt 



\) . Thk 

ot m 



he nor 



vertical direction" 
torms . For examr ' 



Stored 
Jhere , 



where a current mosaic 



adjacent mosaics can oe stored with the current mosaic; 
q7 J mosaic-2B r^can sYore the" address tor • norizpntal "right 
-29 V "the address Tor ■ horizontal let t translation 
lress tor varEIc^ up .transiatAfln (mosaic- , and_tne. 



ransiat 



ion mosaic,-^), .the address — tnz — no.riz.o 
27T. the address tor'verticai up transiatic 
tor ver tical down translation" (mosaicflF 
mosaics ran t>e calculated: where horizontal 
mosaic-28 can t>e calculated by incrementing! 
mosaic-28 to mosaic-29: wnere horizontal 



mosaic- 



address 



adiacent 




. ..-so, addresses ol 
lght translation trom 



current mosaic-28 can be calcu 
current mosaic-28 to mosaic- 
current mosaic- i 8 can be calcu 



decrementing 



tne" mosaic add] 
.Lett transiat 
the mosaic addi 



dress trom 



ion trom 



dress from 



current mosaic-. 



:o mosaic- 
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Mosaic Shape ^ , 

Various arrangements are described herein for overlaying image 
information from a database memory into a memory map. For example, mosaics 
accessed from a video disk can be overlayed on portions of image memory to 
implement wrap-around and virtual scrollin g. Various alternate methods ot 
implementing Overlays W14.I now be discussed! 

Video disk recordings conventionally record a frame having the 
squ.are aspect ratio of a television receiver. Although any reasonable 
t ratio mdsaic can be used in accordance with the jpfesent inYent: 



near- 

as. 



present : 
smory asp 
able" to hi 



Yj 

mage memory aspect ratio 



:ion? 



in 



ing. near-square aspe 



ratio, mosaics 



ics. image 

t may be 
m contigur 



ave nii 




f or example 



, _„ Jig 7C implementing, mosaic trames naying non- square 

aspect ratios. Image memory 752 and window "75.6 are shown having near-square 
aspect ratios for convenience of discussion. Windpw 756 is shown smaller. than 
image memory 752 to permit translation and rptation of window, 756 over image 
memory 752. Window 756 represents the portiqn of the image m image memory 
752 that will be scanned out such as to an image memory map or to a raster 
scan monitor . As discussed afeoye ,, wihCtQW 75b can pg rotat.eg an,g translated 



towa 



over image memory 752 
d an outer bounds 



ary_,Q* 



tne'dat abase "and" inserted into image memory71 
being approacned by window 756. 



cesser 



;rom 



to extend tne outer boundary 
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Mosaic eleme 




from the aspect ra 



10 oitterent rrom tne as 
an in Fig /c:. mosaic el 
5 of image jnemory 7 b 2 m 
in tne if-direction th; 
ics accessed trom tne d 




of image memor 



— = ip*-^ , — 

overlayed on 



elements 



ay b.e 



inc 



ii^row to _Pgrmi t_ ^gjaEer^^ covejage 



- direction to minimize ffie ni"^ef of mo saics accessed trom tne database to 
extend image memory /b^ an incremenl: ini tne X-direction . For example, xz 
mosaics^ are equal in height tQ the heig ht ot image memory 752. then only a 



in_ 



single X-direcTi oh mosaic nee d b 

752 an increment in tne X-direction Simi 
the heignt ot image memory 75 2 7 t 
id trom tne database to extendimage 



i height ot image memory 752. then only a 
ccessed trom fcne databas e to extend image 
irection . Similarly, it mosaics are equal 

two ^ - di rection mosaics 



memo 



to one halt ot 
need_ b 




ort anc 



image memory 
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As discussed v?i 
if pixels havi 



m> desirable to access a 



group ,qe pixels naving an. aspect rati 

^iripT rni.4 can be implemented py acces 
very narrow aspe ct ratio mosaic and P 



ith reference Fig 7C, it may he des 

ng an asp ect ratio that is fail " and narrow or snort am 
iifementea J i?y acqeps3,ng a COlumn PE pa geAj EQX 




and ve 
ma p m 
2i 



3&ai 



spent ratio 



can be mi 



./itn concatenated rc , _ 

e pixels in, a row ana tne sequence ot rows 



or concatenated row; 



are organized for convenient accessing. of wide and very short aspect ratio 
mosaics but are organized in an inconvenient manner for accessing or tall and 
very narrow aspect ratio mosaics. Conversely, for concatenated columns ;. the 
pixels m a column and the sequence of columns are organized for convenient 
accessing of tall and very narrow aspect ratio mosaics but are organized in 
an inconvenient manner for accessing of wid.e and very . short aspect ratio 
mosaics. Therefore, each concatenated organization facilitates , one aspect 
ratio mosaic and does, not facilitate the other aspect ratio mosaic . 

in order to provide for efficient overlay mosaic genera tion, a database 



in order to provide for efficient overlay mosa; 
can bet o med having . du^ game image, one conga^ena^eg 

in tne column direction and the other concatenated in the row flire ct iQ iL^ln 
Ems manner " overlay mosaics can be etticientlv, accessed that are both, tal i 
and narrow and shdrf and wije, jv accessina the ove^av mosa ics from the 



wo scored images 



appropriate one oi 
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Continuous Database Images . 

An arrangement has been discussed for storing an image in a database in 
the form of mosaics. Alternatively, an image can be stored in the database as 
a single continuous image, without being partitioned into a plurality ot 



mosaics 7 for example . an image" c an be toped witn a group ot Pixel yordg- 
ach pixe l word Iflent it :ied T by the .^-coordinate and Y-coordinatS related to 
He location ot tn e pixel word as it appears ; in the A -dimensional image. Tne 



supervisory 



ot tne p ixel word as it appears in tne 2 -dimensional 

processo r can >:eep track" lot tne position ot tne lm, 

gucn as lay keeping 11 track: ot tne co-ordinates ot tne 4 -corners o 



e image in the 



memory map 



ng tn& 
trom t 



map, suc n as py Keeping cracK or une coo 

the image" in tne memory map and tne supervisor 
is or columns ot J pixels trom tne aatapase 
Ftual scrolling Ttus may be considered 
■l mosaic is reduced to a pixel- or a co 
or otner grouping ot pixers . Tne image c, 
ary map form in a tagmon simi lar to IT 
; In the i mage memory map, except tnat tt 



s_or^ ^proce| sor_ cap access jLines 



o~ overlay in fcie memory map 
o be a mosaic arrangement; 



pixels o 

or virtua 
where a mos 



umn o 



t 



pixels Tor" otner ^ The image can be storecf & t^e database 

in memory rn^p" torm"in : A t amnion simif a rE_6 tfiat discussed tor memory map 



row ot 



storage m 

^se a ^ . D _ 

A compute? memory, suc,h as a 



e image" memory "map V except "tnat "the" image" "in" the" databas~e may" 
large me mory map gpmpared to__imaae^_mejnory_. 



comprise a vary large memory map 

, _ ^ — -h— . 



memory, and a di 



single diftiensiohal Inemories having continuous addressed An l&lige . 1^ 
typically a 2 -dimensional array of pixels having roy addresses an4 colymn 
addresses. A single dimensional memory can be used to implement a 2 -dimension 



memo^ 



dimension 
concatenating 



y py r 
ing t$ 



near) c omputer memory, TV, memory map, can be linear xzeooy 

to torm a sindle -dimensional "long row or . 



e rows 
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by concatenating the col umns to form a single dimensional long column, 
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Database Information 

The database memory 



. ^ The database m 

information L u either 
stored" in "tne "gate 



___ databal ^ 

directly" ot can be" modil T§ 



or other processing" Altitude in such a ^altitude 

can be stored in tne dat abase memory, sucn as for topological occulting and 



shadowing, ^c*"*"**** 
in the, . database memory 
.biiity iJlags , edge i 



,w,^n,,„~ ,.;QpQiQg^-.^ — c ^ 

s ai t 1 tude inrbrmat ion, can Pe 

in^omatLLQn,- „sucn, ,as occuJ^tinr 



iored 



cculting information, su 

ontro 



visibility tlags. ecige J t lags . and surface *6 information ■• can Pe stored- in 
database memory. 
~ Database ir 



^formati on can be scored in compressed or in non- compressed 
g ot non- compressed information, nas been previously described. 



form . Processing ot non- compyes sed ir>f ormaEiorf Has "Leen previously 

Processing of compressed information can include dg- compression of the 



^„ ^on-compresse^ ^n^,„ — ^. 
techniques are well Known in pne art . . 

^ Processing of database information can be performed 
such as discussed herein tor processing ot intensity, aiti 
control information. 



%he X 



arious da"ta compression and de- compression 

in various ways .- 
tude . range . and 
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Database Data Compression 




mages 

stores information assc^^. — ^ ^ ----- — , r — _- _ , - - 

glisplayeql. There is often continuity between pixels L _ For . example^ 
intensities, altitudes, 
often nave 
be 



e var: 



r: ^rp:ssre<f*Ky storing parameters, such as raer r i ci effts f _fe, 
dual variations KeFwgefi a" group qt PixeTs . Defining pt tn 
Between pixels permits information pertaining to the variations for a smaller 
number .6f compressed points to^ l)e stored, in, place of the information 
pertaining to % larger number of pixels, yielding .compressed information. 
Information can be d ecompressed b v regenerating the Pixel Param^eters from the 
compressed intorroalion; sucn or interppAaCin . g the 

nnrnftrSsg ft d lntortnatinn to obtain Qe compressed information. One £Q£m _Qf 
fintngrees i nn stores variations Between , SixeX parameters ana one tprm p i 
decompression reco n struct^ tflg v ariation , *fl5°™fft*?l^ 

^ vv " fflany data 2^P^sXion t £ ec^nig\ies can . be useoi^ For example , image PpxntS 
ran F sFnrea in " tie " tornT It coefficients of a^n lnterPQiatlOn Q 



an y data compression techniques can Be useo^ For example, image points 
. .. .. ^a torfid ill the " torm at~ c oe r, t j 5 ijn ts~" o f an intexTOAatiQn pf 
ftxh.rap oi ay.inn equation" £<5 P^gvaqft. inYerpoTiat i , on Between^ qaxa^ oints g r 



■j" 1 aMon gu eguaV.io^ t6 v *flrp*To;^ 

■apoiation trni a flanapoinE. Tnese coetticients can be llM 
ricients : sucn as second 



extr 
coet 
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order, third order, and still higher order coefficients. The coefficients can 
fie ^1 - dimens ionaT. T-d imensionlr I- ■ dimens lonal Tand Higher dimensional 
coetticients. 



a f-dimen; 




configura tion, the da tap can be interpolated betwee 



pints or extrapo 



rom points in a s^ng^e dimension^^sucii^as in 



e coorrtina^.e^^such as 



rad; 



iirection or in 



inear 



g-coqrdThaFes^in 'tne"pi~ane "j^'a ntf" \ )~~ot "£ne~"~ima~g~e 

, a ^ ect "- r Qxtrapolateci separate ,ot , the 



ach o? 



coordinate iz ) ; can )aci i be interpolated or extrapolated separate of the 
coordinates ' Alterna tely 7 We coordinates can be interpolated lor 
fated in combinations different dimensional combinations . such as. 



other 



ions . "such as 
or z and a 
latitude and 



extrapolated in" different dimensional combin^.^ 

l-tfiTnensignai tor altitude o r_Z 

dimensional lnterpoiafc inn or extrapolation tor X and Y...._or_ 
longitude, or R and'theta. . ~, . , . ^ .. . , , . 

In a 2 - dimensipnaT configuration ■ • the_ imag e ca n be interpolated b etween 



Ln a 



. ,.^-isipnai 

pointso r extrapolated from p 
2 -dime nsional rectil: - 



3U2 



fints'in a "2"-1iime^s^onai arrangement;^ such as in 
rectilinear X- direct ion and Y-dire.ct^on together _w_i£h ~ 



2 -dimensional rectilinear X-direction and Y- direction together with 
■ -dimensional rect ilinear 7 magnitude direction. Kach ot tne coordinates; sue 
as the T-coordin^ate Y) and the magnitud 

oordinate fzl " can each be interpolated or extrapolated m PcOrs o 



and 

2-3rmensTqnai XY^ Yl^'and" "zx T-dimensionai ~intef^or^idns~"6r "extrapolations^ 
Alternately. the "coordi nates can he interpolated or extrapolated in 
combinations of ditteren t dimensional comoinatlons. such as a l-aimensional 



the magnitu 
ipoiated in panrs o 
coordina tes' can he prode 



coordinate ( z ) : can each pe interpoial 
coordina tes ., Kor example the x , Y, , and! 
2 -dimensional XY. YZ . and ZX 2 -d imensional 



ssed as 
ations 
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interpolation or extrapolation for altitude or Z and a 2- dimensional 
interp olation or extrapolation tor x and Y. or latitude and longitude, or R 
and tneta~ ~ ~ " ~ ~ ~ ~~ ~ 7~ -, i„_ 



pointl 



n a 3 -dimensional configuration, the data can be interpolated between 
ErapoTa tedtrom points in a A- dimensional arrangement .• such as 
LsaShgil rejtiiinejar r Y-Qirection and Y-direction together with 1 
rect^on: ~ Each of tne coordinates: such as the 2-coorainates in 
IThe image if ana Y) and the magnitude coordinate (Z); can all be 
or extfrap olated in a 3 -dimensional ~jcoritiguration. J?or example' 
and 7, co^Srdinates can he nrocessed as 'a a- dimensional XYZ 



in a 



mil 



ane _ ol 



the £? V: and 1 ^ cdo^rdinates can be processed as^T 

interpolation or extrapolation. " ~ . ~ . _ . . 

gom press'ed l ntormStion can be decompressed prior to loading into image 
ia'tna t images i n image memory are J in decompressed rorm. AiternateivT 




example7 an incremental processor can be implemented to provide 
1 - dimensional . 2 -dimensional .~ 3- 
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points having a third orde r i nterpolative relationship therebetween, 

438 

DISPLAY APPLICATIONS 
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Genera} — n n _. — ^ J — ^ — ^ processing disclosed h.erein are man- 

invention. 



Display applications for the image processing disclpsed here 
and varied. Most display applications currently satisfied with 
systems can use Ene p^esefot rentage processing .systrem or the PresenE 
Signer in "replacement or or xn u &<Ap±io^ £^ tKe- ana OJl^ -Capaja^ 
C(l and C ifi'SppIp-ations include \ CAD /CAM, simulation. inQUStxE 
graphic work: Nat ions, graphs computer aided instruction 



— „ — _ — ^j|t^\3 ____ 

graphic work: -sta t ions, grapnic arcs, computer aiaea inscrucliO^l^Mrr^nd 

many fitg|C|^ applications needing image processing capability can use 

the pr^ nFift&ae processing" system' or The pfe sent indent Ion 7 These image 
proce ssing applications include medical image processing, video special 
ettecfcs 7 apd_ many others? . ~ ~~, 771 ~ ■ -, 

A brier discussion of .typical applications will now be provided, 
followed by more detatiled discussions of representative applications. The 
system of the present in vention can be used for training of personnel, such 
as a'aimuiator r as i a di'splay tor a vehicle . such as tor an aircraft cocKPit 
rtis piayf"T:or lnyestT^ or large dynamic range database 

Ynr ff^tion. such a^ appTl cat ions 7 A 

Eralning simulator applic ation is characterized by a drone aircraft having a 
remotely controlled video camera tor communicating with ' 



remotely controlle d' video camera rbr communicating witn aground-based grew" 
camera im ages can be ■ "simuiatedT dynamically driven as a function ot vehicle 
XQll . pifcc ff w ^ncT yaw dynamicsT ~venTcTe PalEifcude? and other parameters . A~map 
display can be p rovided^ for displaying a terrain map. .such as on a cocKPit 

flipglay tor a tf ilo^ a n — 

vehicle latitude and longitude and the 



y u^ated as a function of 
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perspe 



. ctive of the outs ide world by viewing a terrain image that changes 

spatial comp res sion as a tunction'ot altitude, changes in orientation as a 
f unction or ^heading . and that provides tilting capajpiiity with range-related 
spaEiai compress lo'n as "a tunction ot pitch and roil. Supn a map display can 
Rave superimposed overlays, such ^. as tQP QgraphicariL^QYgyiays tor terrain and 
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c an be stored as a group of mosaics in database, memory, a. medical 



investigator can control the sysEem to roam through the image arid zoom on Jcev 
points "of the image , similar to the image evaluation application. discussed 
^bove7 The medical investigator can zoom* out to see a large portion of the 

------------------- tfte image to an area ot --^ - 




or 



In an animation app lication: image s, such a s background images, can be 
storedin database memory and accessed a s the ani mation- scenario progresses. 
Images can be overlaid with grannies : s nch as ca rtoon characters': vehicles? 
trees . and otner graphics. A's tfhe scenario progresses, the detailed images 
accessed trom vide6 disk: can be translated, rotated, spatially compressed; or 
decompressed, and otherwise processed to enhance the animation scenario. For 
example, graphic overlays ~ can ne provided ror translating across TM 
background-, being oyeriayed on background images which are rotated 
trang^ated_in_conjunction With, the viewp ort jjositi on^d^spatiallY^compr^ 





:ial comp^ 

tirplane , Similar to tfiat discusse.a tor tfte simulation application nerein. 
Processed images m animation can inrl ude terr ain, clouds, water, and other 
texture type 'images. This animation f eature T n an ne used tor video games. 
movies . teievisiQ -h" and otner appucan nnfl 
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m a satellite 



satellite application, an investigator can investigate land 
discussed above tor image* evaluation applications 
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or static map displays, such as in a re mote — sensing, px. cartograi 
a pplication. Tyfovin g ^ displa y s can be used in various p^attprpis . inCMy 
Sp ffiecrart; aircr^£7^ sucrt afe in Fixed" wing , Tighter aircratt and ^ 
Helicopters r grouncT vehicle s . such a s tanks ajfa tracks ■• , s eacra tt, sucnZ Ia 
gyrf acV ships 3 and [ >ubmarjjie s : sWio n ar v " " l o^catiQns ." such as gui J-eUnqs an d 
r i ftia sfaa T iSns rand in . other piatT o m sV^taVic^ laap qispTays c an pe used in 
various piattorms including buildings and tielcr stations and in moving 
pfaFForms: such "as ^ in spacecraft . aifcrattT grounq vehicles, and seacra SEI 
The > moving map " display tor aircraft aistussea in detail herein _H 

represen tative ~St EEe jr oEner map display implementations - 

* " K^ vmg mj$ cTispiay system can be gypgessog 
discussed nereiif. 'MoSai 6 m ap images can Ye stored in a database. 3ucnas_a 
video disk or video tape aatahase. _ and can tie fetched , and displayed m 



such as 

ca n 



_ication of a large database system. 
herein: such as for remote sensing. 

such as in a military aircraft. 

got cartographic 
flat-. forms including 



splays, sue! 

fl a- remot 



pcordance with the, virtu; 



jpserver "motion, such as mq„ 
ispiay^ _For ^examp le ^ j as^^tne 



transition ot tfie image pro 

translation qt the "map in the display as the aircraft flies over the reiatec 
terrain. As the aircraft 
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processor window provides expansion or tne map in tne qispiav as tne aircr 
flies over tie , rfiiatfid terrain . As the aircraft oanks 7 range varia 
compression ot the "image processo r window provides jD-perspective of the 



e. 

map 
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The moving map display can be implemented with geometric manipulation of 
map image s troth a database as it ^ the display is a special optical window m 
the tioor ot "the cockp it T As the aircrStfc maneuvers , t he image , processor 



the cockp it, as the aircratt ^maneuvers , the image processor 

tic map -mages accessed f rom the database to generate dynamic 

consisten t with aircraft maneuvers. For example, as the aircra" 

~ the viewport: as the aircra 



the tloor o 

processes staticHrla 

images 
msl 




and as an aircra 



compressec 



expande 



as , if , it 

e aircratt, 



ere 



provides ground 



controlled window 
as t ime is 
overlays? 



limited^ only py 
m thg database 



resolution. 



igiE l zed imagery 



" s pecial "visual effects can be provided £ox , improved operator 

erf ormance . For example, the geometric operations ot rotation, translation, 
^pansion 7 "and compression are - supplemented with a jb-perspective capapinty 



fxpansion. and compression are' suppiemeni 
D-perspective _p"rovides rangje-relat 
3D-perspective . Therefore. as _,the ^aj-rc 



showing terrain of] 



side-l dotting 



/ides range- related compression . consistent with 
efore. as Che aircraft banks the image also gbanksS; 
to the side ot the airc ratt towards the horizon. This 
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image is c om pressed as a functi on of the range tow ard A vpshff po^nt that 
i s fisyond fiis n^izon, ftucn visual cues , aid an u ma3.nr-aining a P*ffilf 

perspecti ve. a X"g u g^gf AQW VJ.BAftJul.lty £ 43,fffit, ^ u anfl aifl XXX VlfiMi 



il.ity ztfgE. 
it-io« ann ati 
he ennancea 



perarons, sych as dead 
Utilization ot data 
tnaEi on and cnen qi 



recRomna naviaatio; 

. ha rp memory "can Be enhanced I by s t ori, 
eoomnres sirig the inrormar.ions . sucn 
lo on tain decompressed imaae mrormat: 



anqecT lyy st or j.na_ j; omr^r_es s.gd 



as 



_an 



p^rpA^. ^m^n B * d^^ ^ tor Tma tfe 

Pr0Ce .^ ymn 1 otic images can be overlayed on the picto rial image. Symbols can 
inr.ln ^r ^viga^Tgnal ^ s y m bols ; *s ucf i a s ftgograpfiic al . T^ S r."£%^FP^ 
idengiticaFionV and alphanumeric legends" tf y ttb oUs can aJ.SQ i nclude ffpath &ay 



yS Image a 7 su^H a s flight corridor images 7~ ; 

lays provide for l^rovecf. operator interfacing . Symbols can be 
L for Characterizing fricton ar features ; such as^ cultural tea tares 



in the sta 
Over] 



overlayed fbr Characterizing pict o nar features; such as cultural features 

anrT mTli tary fhrea\s\^ ^ MpMnSme^ oyeriave d"" tQ"r characEmz x m 

n-i rhnriYf feafare s " ancT^roviding supplementary information . sucft 1 15 




overlayed: sucn as_a 



yt 



sucn as an altitude 
tie stored in $rie 



ion. For example , 
e database, either 



447 




Overlaying into image memory was previously di^squssed relative to 
scrolling toward an edge of image memory. Other condition s can cause the 
displayed to move toward and through ah edge or image memory, sucn as 
rotation and [compression . For example, rotation ot a window that is near an 
edge and .that is aligned~with an edge ot image memory can ca use a corner of 




and that is aligned with an edge ot image memory can cause a corner ot 
window t o rotate " through an etioe^ ot image meitfory. Also, compression 
g t^veiy expands i tne i wind ow, silcn as with under sampling; Where an 
rj-.ru_-j.„j-_:fl- — houndEy. jie-~ 1 — ■ ■* — 



;t^veiy, 5 
ding wiridc 
dat'abase 



ence. virtual scrolling 
motion ot rotation and 



?xpan 



lg window can cross an image memory boundrv, -.. = , 

trom database memory can also be controlled as a function ot roi 
compression? simiiaf to fcnat previously described tor translation 
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Altitude information can be stored with an image in compressed or in 
non- compressed form in "database memory . The altituae information can 
_ - --Lz. . ^- ^at jTon 7loaded"intg an intertace butter memory and 

- ----- sing sunn as sna^gw 



accompany Intensity information loaded into 
can be used for performing alt ltude- related 
processing and t opological "line and color ove: 



-proct; 



:pr 



ucK as to §oIog^car*occult3.ng processing; then the altitude information can 
e"Ioaded intg ima ge "memo^ subsequent altitude processing is 

ot to tie performed: t;ne a Ttitude lnfof^arion need not t>e loaded into image 
iemory; thereby reducing tne word size in image memory. 



not to be 



memory.- thereby reducing tne word size in image memory. 
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Informational Database Application 



and 



rmationai Database Application , . . 

A database can be lnfo lemented haying information that is first accessed 
then image processed for presentation or tor recording Tne database can 



sucn as tor an educaEional 



)lTcation: an 




. or 
selecting a 



cesseu images 



extens 
fcir 
images 



Qmputer 



.aining information in cjicjital, form are used 
.-j..-^ — . « — - itffeo disks can be use J 




le _ storage o 



issec 



erein; 




1 nations of digital and 
prpin ran access diait-aT 
The images can be image 



ntormation from a database for display. The images can pe mge 

, r w provide ayqamir.gJ Ty movin g images" rr6m static database images. 

fnvesflg^ion oryrc^ orl aT i nt o waf x on can be enneffl Cftd w^fn ge omi^rlc 
Tor "example 7 an auto me chanic can select a diagram of an 



processin g For example, an auto mechanic ca; 
automobile tor presentation and can then control 
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and can contro _ x _ ra 



_. >rmjtion can be enhanced .with — geometric 

processing. For e x ample, an student can select a aiacrram pfc an obnect a nd 
cause the object to move in accordance with physical pr inciPl es to facilitate 
learning ot T.hosp physical principles. . , ^v,,^ 

An a encyclopedT^ appli cation ^Isrepresentative of many other database 
informational applications : such as a di ctionary applications . a financial 
- - Tmation a technical report, application, and Other applications. An 
vciopedia can be stored in a dafaoase. including text and static images. 

e images to provide 




The- image proces sing system can He used :o process the images to Provid 
dynamically moving images in res ponse to the stored static database images 
For example, a person :^ aqcessing ^encyclopedia intprmation can also access 
, y> y?vi»^>L.__^ _-_—^L ■ j_-y ^^manipurate this "image in transh^ — 



related image and can" c^na^^ m translation ^ 

roFation. expansion, and "cc>mpression to petter view the image and to provide 
additional estHeF ir and "learning capabilities . ^ A motion scenario caxLJae 
stored in the database t or automatically providing motion tor the image" 
Therefore . static "database int ormation can £>e automatically converted to 
dynamic intormation tor Petter presentation. 
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dynamic processing 
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High Definition Television, Application. . , . 

High definition television (HJ)TV) involves significant data compression. 
This can be achieved bv reducing the amount of redundant information 
communicated. In a television, picture, a portion pf the image bandwidth has 
to do with either static information or with information . that has been 
geometrically modified Usually only a portion of the image pixels have been 
created or erased . such as with ocMt^ ng a _ nd __PA^Pi?^ig.' ^t^^gyfL. IQg n ^ Of 

Liec 
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Special Effects Application 



, a low cost special effects system can be used — m a 

application, a business graphics application, and other aPPlic 

example, special effects' can be "used to generate slides tor business 
presentations and to ^generate^ gra nnie art images tor advertisements . Although 
the linal product ot "a graphic a rt system may he static photographs, real 



used in a TV studio 

at ions. For 



he rinal product ot I graphic art system "may be sliatTc : photographs , real 
ime operation permits /an ^oper ator to etticiently and rapidly configure 
images. Real time operation and interactivity enhances productivity. : 
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Remotely Piloted Vehicle Application . 

Remotely Piloted Vehicles (RPVS) provide an application for illustrating 
various other applications of the image processor of the, present invention. 
An RPV can have different types of sensors and a data! ink for communicating 
sensor intormation to a ground station, image processors on-board the KPV and 
in the ground sta tion can enhance operations "For example a video camera in 
the fev can provide video images a radar system in the RPV can provide radar 
images aT side -loojcino "radar j SLkf in thV " ffPy~ can provide" ShR images . a 
forward- looking lntrared PUR) svsr.em m he RPV can provide FL1R images. 
and other sensors in the RPV can provi de ohher images. These images can be 
processed or pre-proces sed in tne rpv. can be communicated to tne aroimH 
station, and ctan be processed or posr -processed on tne ground. 

Pre-processing in th e RPV can perfo rm variou s tunctlons. Pre-processing 



ermits data compression to impr o ye_coi^unicat^o^ 



im prove communication b andwidth reauii 
enff "op eration, where pre -processed 
the RPV rgr'Tafcer transmission or tor 



on can 



emits . s.iien 

stored 



irx_ 



or later transmission or tor a ffdata 
Eaice tne rorm or /digital rlltenn-g 
tion to identity meaningful imi 



dumpfl after land ing . Pre- proces sing can 



reduce r edundancies. pattern, — recognit ion — to — iqeuw^y ^i m ggg 

tgagilres and To derive the oharacteri sties "and geographical location Qt_Lria 
teatures of interest . ana other such inmX^m atJ^na. narfnn , „ . rtlie 

2^ v,vw fig5und-5asecL processi n g ana ppsX -processing can P e f£P™ ,,, va f i°}*p 
f unctions: GrouncT p r ocessin g provides ; tor <fa ta T de- co mpression to reconstruct 
images "transmitted In compress e d torm. Ground processing Permits image 
enhanceme nt tor evaluation Dv a 



ttern r ecooni 



lty meaningtul imag 
pnical lo cation ot tn 
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_ges tor evaluation is an 
such a s with a reference 
translat ipnai registration 



the ima ges" into rotational orientation 



t Herehe tween ." by "expanding'br c ombre s sing ~£ he Images "ant 0 > s calf" regi s t r ation 
therebetween. and by warp ing tM ^iqageg to _ taci jitate registration Between 



ot the images. 

■ sucn as automatic patte rn recognition or operator visual 

i, can pertgrmea "more. eftectXYe4Jk- ^. Qr ^~ g . 

ftiliEat es mat cnma with jrererences for pattern 



:aciJitate regi 

ter registration" has been accpmplishe 



oetw 

'llSh€ 



importan t teatures ot 
pattern recognition 



pattern recognition 



warping' ot an image taci 



jit at 
iitat 



,jr Jiung wi .r, , „ „ _ «— c 

recognition.- image warping taciiitates matching ot reference images, such as 
to pologica l ^ maps a and"g|ograpKicai sate^iliYe images . ¥or example . aaroorne "im 
agfes'Hnat are fiistortid dan be compensated; sucn as images that are gistortfij 
dfle to vis ual errects iTe. range variable perspective.- camera etrects . Isuc; 



as"iens"diBtortions: geogra pEticaf effects. 6 s^Tc^f^ earth curvature; and othe 



3Si 



such ettects. sucn "image" warping can .correct qis tort ions ^pr - 

o perator Interact ion and^tor improved automatic pattern recognition 



DX improve 
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Images can be recorded for process in 
R ecordin g can pe per rormea with conven 



sing a 

tionai 

5 C r^i-Cr ■ C 



nd evaluation at a later time. 

-ices,- , ,sucn ,as, RfW$, 
si 

cpnventionaT mem 



memor; 



^ eyices,- sucn as. , , , 

core memories, digital bubble 
' ' ' - ies; and can 



memorie 



magnetic disk memories. magnetic 

video disics. and othe] 



;awriiir.rrii i i ' 1 ? * ' — i 

he pertorme 



video 



r / v r^^VV Vi hr it > hr J W^^V* 

unconventional memor 



memd%; 



^pal mg 
q analc 



»vices; sii 



ills 
ere 



e signature 
ne CCD 



an 



latent ' ap plications and J patent s~"by" Gilbert P . HyatX referenced, herein 
Recorded images can Be played pacx ana evaluated at a, later time. — F_qt 



memory^ _^an 



sciosec 



am ple . an operator at aff image processing console can contrd 



a i?t 

ntrol 



tffie "recorded imac 

translation, expa? 
in additipn t 



op erator at an image process! 

e -record ed^ images to lnveatrgate the" images ; such as wi 

---rision. compression, warping, and spaciai tiiterin 



SB 



QCess^ng of 



rotation. 



in additipn to im plementing opera^ioEa? requirements, the system c 
resent invention can Be used tor, implementing simulation requirements. 
s tor training simulators tor kpv systemsT 



;iai tij 
its, the 



of the 
suet 
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r „ ligita^ ^ 

translat ion, expansion, and 



video camera . Translation Is similar to pann^nc 
is similar to ro tating ot a video earner- 



loming effi a video camera Theretore. an image can De capturea, 
a conventionaj: mechanical vicfeo camera . in a pasic image torm; 
then be panned, rotated, and zoomed digitally with the "digital 
as It the mechanical camera ltsert had performed these 



similar to zooming or a video camera 



such as with 



the image can ZEE en pi 



yidep camera as. 



The digital video camera has important advantages over, a mechanical 
video camera. A mechanical vid eo camera can usually capture an image a single 
time because the image may no longer be availapre. conversely, the digital 
' it.eratively modify a pre-captured image to provide 



video" "camera "c\n iter ativel v modi ty a j?re^<^tirr~ed Ima g e to pr 
multitudes ot dpTtterent T forms crt presentatiorii without losing the opport 
tor capturing the basic image itself, Also. a mechanical viaeo camera m 



unity 



tor capturing the basic image itself . Also, a mechanical video camera merely 
records motion ot an image and then is locfced-m to the . particular motion of 
that image in pre-recorded form. However, the digital Yigg° camera generates 
motion from a, sta tic .image and proyides^mu^ti^uQi^s, 9i : - ^^ e §f n ^Q^f ) n 1 ar ^ s t .g| 

is provides various 



motion from a static image and provides multitudes ot j 
motion tor tnis static " image "independent ot the met 
original object trQm which" the lifage was derived 
important capabilities not available with mechanical 



video cameras.. First, the 
from a , s ^""" ~ *■ 

control la 



458 




generate a moving picture 



camera c 



scenario to 'the par 



gen 
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are relatively lnU^^... , — - . , _ 

an image processing system will now Tje discussed that facilitates 
f lfixibiliT-v ; and^lii gn cieFaiI J in landscaping. A database ot obiects , canlEe 
(jonsEructea: sucn as shrubs, trees, busne^, grass, rountains; walls . an d 
other plants and structu res Database c_ons taction u can tg K,| ^orm ^ne 




tor image manipulation. \. " 
T An image can be. "constructe 
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overlay objects to improve the landscape image. For . ex ampl e. , a shrub can, be 
reduced in "size and translated lo a aitterent position with an occulting 
priority set relative to other overlay objects. " ~ ~ ~7 

o cculting priorities can be assigned to overlay obiects as thev are 
selected and accessed Fro m video memory. For example, an occulting priority 
can be "assigned w ith a keyboard "entry. Also. occulting pripritiei? can I5S 
assigned Tby -slewing 01 rande."/iTcn as Vith a loysticK . uccuitmg priorities 
can Be used in accordance with tne overlay contigurat ion discussed hereinT 
such as tor selecting which, one ot a plurality ot overlay images that till a 
particular pixel will be displayed. . " ~ T 

colors can tie" assigned to overlay objects and can be modified under 
architect "control . For example, intensities can be selectively increased and 
decreased: such as inc reasing ot the red intensity by a tirst tactor and 
decreasing ol the green intensity by a second tacto'r . 
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lotographB Application . . , „ „ . , . 

Videonfc^sysftem permits video pictures t o be recorded with an inex- 
pensive camera, enhancement as it the "pictures were recorded with an expe- 
nsive camera, and intera ct rye real time viewing with exotic special eltects. 

video pictures can be recorded on video tape with relatively low 
precision eq ui pment 7 The recorded pictures can be enhanced and then displayed 
to higher precision with increased' spatial resolution, such, as with a larger 
number ot pixels: increased color resolution, such as with a larger pallet; 



number gt pixels: increased color resolution, such as with a larger pallet: 
improved sharpness, such as with edge enhancement: improved smoothness: and 



reduced noTse". . ^ . . . _ _ ' w 

The viewer can interactivel y contr ol special effects: such as panning, 
zooming? and warping ot the pictures . interactive viewing is performed with 
the image processor ot the present inve ntion, such as having expansion tor 
viewing magnified featur es. Compression ror viewing a large area, rotation 
and translation to change viewing conditions, and warping to provide special 



and transition to change viewing condi t ions and ^ "warmjicT to provide spec lal 
etrects" For exam ple, -racial closeups can be obtained trom expanded group 
pic tures and ' panoramic landscapes can be expanded to view" interesting 



pic tures and panoramic landscapes can be expanded to view interest — 
features, with substantial image enhancement . keai time interactive viewing 
converts viewing rrom a s pectator operati on to an interactive participat 



converts viewing trom a s pectator operati on to an interactive participating 




sc rolli ng and znnmina Pictures can 
. Processed p ir.t- ( ures tnat he 
ransiateri. rotate? 



ve fteen 



'"^es 

ann warpe 



can 



permanen 



as on video ta 
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Stafic viewi n g, can be impleme nted with the freeze f Fame capability of a 
I memory . siTppiem e nted By image enhancement ana interactive OPer at ig nl 
e Tra me i Wer cmmpn J w iEH yiefeo tape svshms . can De eliminated! 



video 



?reez 



:rame ]i 2 



Geometric proces sing can be used to mye 
positioning" and zooming to enlarge | small 



fc — 





c image, such as 



e used to myes 



iaat£_a_s 



feature 



screen size. 



Electronic Puppe.teer Application . 

Animation is generally implemented by .drawing of individual, frames 
having motion therebetween and then photographing the frames and n playing them 
back at high speed to simulate motion. Because, of. the extremely long times 
needed for generation of each of the frames, it is necessary to carefully 
choreograph and plan and draw the motion s.cenario to. provide .good motion 
appearance when played back at high speed. This process is expensive and time 
consuming . . , , , ^ , . , , . . 

>n _arrangement_w_ill_n ow^ 



with true mot 



minimurrrot pre-ptahhihg.'a 




generatec 



it hi< 



?eq W3. 



^puppet eeWor 
; "Scenario "For 

s, and , re J, at eo 

Ld on trie gther 

. where a sirst 



to control 



nages 



go tnxou 



controls to ^ofiCr o f an image ovefiayecf on a bacKqrouha iitfaae ana on the. 
images T Kacn ot th e ? -puppeteers can control a ditterent image ■• where a 
puppeteer can control a fiero imageT a second puppeteer cancontroi a 5 



IBSSE 



ers can each ope 



3d 



set" or ^oystio 



isceer can control afiero image, a second puppeteer can control 
^e . and a tnjrci puppefceer can ^control a villain image, The paidp, 
i control fcneir^rfeTafrecf image fco interact: with the other lffiic 



eroine 



eers cr 
and ' 



eac. 



ges 



execute_ a 



nteractj, 



:enario 



ween images under control q 



pontaneoua'wrfc'h "a" milT£mum""ot" pre-planning' ancf c^o^rgograPhvrVor example?r5 
attle Between a Hero and a villa in can be implemented under control ot the 



eteers can be relatively 



ro and? a villain can be implemented under control ot the 
minimum script direction : such" as to generate a battle where 
liaintight7 resulting in the hero being knocked down 



ppeteers 



ie vi 
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several times and eventually resultinc 

tne pupp eteers can implement lilie Ipaft' a „ 

respective image s to provide a type of battle. 

Another contigurfc tnat cjin be implemented p_s with th 



q in the hero overcoming the villain 
i e and can intuit 1 ve Ty con t r o 1 t ne 1 



:o t bl low 



5 



ne "puppeteers 7 rnotions. 

----- - lbow, shoulder 



simulated "battle between tnemseIves~and P instrun^n£ to"con£r&l" jr tne images 



s_ and instrL, r »w^» »»w^w~. 

For exam ple trie puppeteers "can nave tne 
nlder. necJc. torse?, Xnee . and hip iQintsT 



eir 

puppeteers in 
?! tf 



main 



glloj 
hody 



<y j pin t s 7 such as 



lgstmmented tor cont roI"o|f_ Ehq_ corresjondma^ iqi^s_ on_ the image 



ario being performed Jjy the puppeteers. Real time operation gt the 
conslstefit^witn pertorinance fct^flaily activities in real time oy tne 
-s and hence can Be easy to implement with this system. . 
above arrangement is an improvement oyer non-real time animation 
;s. which are pertormed sd slowly that they require extensive 
ling ot the" animators to proviae J such very 1 slow motion trame 
n. Tor ex ample, an animator may spend an hour generating a trame, in 
to the apoye electronic puppeT.ee"r arrangement which can generate a 
»ry jj-millisecondsT 



joints on the 

££• Re al tim e 



e, scenario ^eing per^gme 



system is cons 



^ fne above arrangement ..ii 
techniques 



gpngitiprun 
genera t i o; 
- p n trast 
rame every 



Flight Simulator .Application 

^ ^ t h gJL . igftt, gimtflat Q ir, 

bomb 
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simulator or 
epnic system. 
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Traffic Accident Simulator Application 

A traffic accident simula.tor will now be discussed as illustrative 
general applicability to other simulators; such as of a traffic simulator, an 
accident simulator, apd other types of simulators. It may be desireable to 
simulate a traffic accident on an image processing system tor the purposesof 
evaluating dauses. tor evaluating liability, tor presenh aEion to a court anc 




expansion, 



com pression. and translation — £Q — prpvj.de — insight inta the accident 



contro 



a plurality Qt^ye 



uai 1 veni niiar enyironmenT 



„,,,_ , fhe vehir '|p overlays can Pe rotated. 



TYs forms 
irn vidua!" 
Ue overT 

gre accidl 



tin one 
If 



EE 



flefl. anq. 



e veniriP overlays can pe rota 



translated, expan* 
rator in 



conligur aFion. over 

computer grogga nTcoja^ro 



ed, anq <: 

Lteractive 

irlay dyn 



com; 



nress 



lynamics reiat] 
1 r.o roliow a 



eti to simn late accident dynamics : such as 
of anJ linijpr r nmpur.fir control. in one 
viahive to 'Fife gacKaroiInd image are under 
w a pre -rtfltinaa accident scenario. Tne 



rotate, translate. expajffiand 
such as under -loystic* control, t 



ipress the pacKgrpuna imag 
Mt investigation or tn 



operator can 
and over lays 



compress 



accident 
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to' view tne 
changing tn 



irst car as tne second car is approaching 

operation can b 



arid to rotate 
si owed ,£5 




e operator/ s^ perspective 



r ma the operator 

ua observation ol the , QC"currence§, - can pe speeded , to QPtaih a nxgn- 
p^rsp ect^ve. arid can oe stfoppea lo permit still rrame investigation? 
ent accident scenarios car T ^e^simuiat'ed in accordance witn conflicting 



can , Be .slowed to pgrmfc 
peeded to optain a nxgn 

frill frame investigation 



tne ocfeii rrences . ' can pe speeded to octain a'fti 



erent 



witness observations 
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Train Simulator Application 

A train simulator can be lmplemg 



presentl y m use Jy the railroads anc 
fie partme nt or Transportation. iJucl 
valuation, crew training, and other 



be imp: 

iroads^ 



in^ accordance^ wi^h^ t ra^n jg jmuiafcor^ 



simulators q& 



valuation , crew training. andr^ther such purposes. ^rTone such simuiatorlZa 
of. lorTlSase witn"a locomotive cab is "used to house the trainees . Terrain 
long the H ghg ffr way jis presented witn moving PicYurg displays ^recordedZon 



>e usee 



ccident 



Dl 



;ill ggame^cameraj 



_s 



rames 



processo r caj access trames in accordance with the Virtual scrolling imp- 
lementat ion disclosed herein. TOe processed images can Pe directly displayed 
witn CM "monitors simulating windows qt : the locrimotive cap. Alternately, tne 
processed images can Pe" projected witTT * nronection television- tvoe 



processed images can Pe~ proiected with a proTection television- type 
arrangement lo p rnvide larger- screen images that can pe viewed through actual 
windows o£ the locomotive cap, One torm or projection display is disclosed in 



windows or the locomotive cap, one torm 6T projection d __ 
Patent no. 4,435,732; which is incorporated lierein by reference • 
Different scenarios can be controlled through th' " " ^ 



Different scenarios can be contro 
througfi the video memory tor non- sequent 1 
virtual scrolling' capability. There tore 



rougn tne capability to branch 
trames m accordance wi^h the 



tual scrolling capaKT fity . ThereE o?e7 different scenarios , "such as taKing 
either oFFvTo p ains r aT a railroad switcn point can Pe simulated. 
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Train mo tion can be simulated, such as by 

--— ■ ■ - - - ----- _ ^ d p nvironment: . Tf ; 

as with a locomotive 

~y* ' c* v\ o m o 



Train motion can be 

rate through the image pr 
by the operator, 'sucn 
experimenter, such as wit 




n an experimenter 7 s pane! 



scena i 



riQ • t 

~ This "arr angement" "facilitates ease, of database generation, 

branching capabil ity, and flexible scenario operatic - 



or py other means 



rapid 



Lon , 
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Helicopter .Training Simulator .Application 




exceed thoSe of other air'craft simulators. For example, a helicopter can 
approach very close to textured obnects. such as trees and buildings, while 
Higher t lying air craft may noFT need close-up simulation or highly textured 
opjects" J Aiso. a ^eTicopter has 1 more"discontinuous tlignt dynamics, being 
aple to c ruise at high ground speed ana t.n hover at zero ground speed; while 
higher flying aircratt 'do not have such dynamic capability. 



alators. For example . a heln 
cts. such as trees and buircfr 



~do hot have sucn dynamic capapi 
mil a tor can p(g,_ ^P 16 ? 16 ? ^^^^^-!^ 



prpyi 
ex 



a h^icopter simulator can pe. impj,emen 

ding a Ip^ckground image and with various 
»le.~ a ba ckground lmag'e can Pe provided 



image 

aced ±h 



^rocessor 
eyeon. for 
id 




the foreground object and 
ma napa h-Uities aisciiaRPH 



iTih a complex 



'ration 



a ges and the background image through cne spaces Between 
-lay Free . The e xpansion capabxiiT.v discussed herein 



complex imagp 



discussed nerein provides tor selectively Q verj.ayj.nq Twit -h a gffr „, oti ,=,„ 
that: "permits viewing through s elected portions Qt . the SWCfl .gg y* ew * £5? 

ot offler nverlay l ifegaB afld the/'backgrouncl image through tn,e spaces , betw een 



leavef nf an ovefray tree. The 
facilitates approaching an overlay 
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object, such as a tree, and havi ng the obiect . expa nd in SJ.se as it ■ i 
approached to simulated -pe r s pective . ?or exa mple . a tree Qveriay ^aJLaj^ 
over the mrkaroun d image W a very smll overlay; image can then be expande 



mall overlay" image can then be expand ed 
d , beyond tilling the viewport as the 
.ifles behind the tree,. ; , , 77 7 7 



to" tilT the i viewport Tgnd" to expand~l>evbr^ tilling tf 
KelicQpl:er"approa^ the tree ana hides 1 behind the trge 
An attach helicopter simulation can pe lmpiementSsT 



t he jres e qtT invent ion" _££ ovid^u^ 



i pprement 7e7(f "with the system of 
>!: ctet a 1 1 and rea lism. Mu 1 1 IP 1 e 
• • kground - — — 



leve 



video : Yie lding a "textured background image 
wu.n vveJ .layed textured obnectTs. su3i a^ t r ee ^ 

pxgmple7 the background image can have textured mountains, hills, wate rways: 



high detail oyer 



5SxS£ 



m, be jprovi 



with overiaye 



wildings : "anc [meadows. X group ot textured images ; such as trees, buildi ags^ 
md ground venicTes 7 caff be overiayed on Ttie background with occulting 

Ln one example, a tree image having texturgd^leaf ^and^b^anch^detail^can 



be ind^endently^mani^^ 



scaled. perspective 
background ; image 
- - — n£. 



rocess 



jn^tia, 
object 
pa — 



and' warpe 



textured' 



d^s|aT it ^backgr 




ckgrQU] 
eli copter 



Qbj ects 



eiicopter tues into tne Background toward, 
s approach. increasing in size, and pass to t 
ortrSy" the etfecti ^oF motion ¥ifn"pefsp" 
cne^ the tree, the tree expands to till tneT 
e 1 viewport . The h elicopter can nover behind 



e tree, 



o the sides o. 
spective. _ as 



1 



eiicopter appro 



en le viewport . The i _neif cop ter c an hover^ 

play of details ot leaves and branches in expanded 
tree 



_ viewport anaTo 
hind the" tree : with 
orm to high detail. 



jxten 
iJLfl 

Eel 
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helicopter causes 

:kground 



1 



r "hover s" beh^nri^ the L tree, image,, ^^mqtj.pn _ of 



ative motion q 



mi 

si 



image" an d" oLTect images oehmd iSe tree' in accordance wTt" 



ee "image and the occui 



perspective "considerations 
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Large Image 

Process 

Landsat image 
transmitted ^' 




je considered to be 5.0 , ouo -pixels sc , . _ . ^ 

per image, and the image wi.ll be considered to "be transmitted, down at a 
2.5-MHz pixel rate, requiring about 1000-seconds for transmission.. The 
transmitted image can be stored in a database,, such as implemented with a 
Winchester disk. Large Winchester disks are readily available having near one 
billion bytes per disk. Several Winchester drives can be used to store a 
whole image . . . 

server can assess the_ image,, such as %/p locate particular features 



^ . The observer can assess the image, such as to locate particular features 
of interest:. Assessment can include":Son the tiyjtf assessment as the image is 
Being .Toaded and work station assessment at ter tne image has been captured in 
the database, tin the [fly assessment provides some limitations on the pixels 
that can be assessed, based upon the scan pattern and the progress through 
the transmission. Work station assessment provides greater flexibility 
because the image is already captured in t he database and there tore available 
tor image processing as a wnofe image. The operator can initially compress 




•I 



s can 
sea 



For purposes of illu s tratio n , a Landsat sate l lite w U l be Assumed to 
Vhe earth" with f- d i rr erent sens o rs, £-visu a. ) sens ors afid ,4 -infrared 
tp. i" generating" 4 -di fferent images. I'ne images are each digitised into 



iensors generating fe-ditterent images. The 6 -images are eacfl qfrHACasea into 
CT o- paerfrf-! ? 0 , W-meJ, , Jimags , for a X^biUion . pixel image. The 
T ima ges a ^e muIiiplezgQ fcogetney a^ £ransm i tt.fi(i to a gxwnQ l^ion ?n 
ligital s jgnaj fgr ff ' The_ jgiages are_ demultiplexed ana stfflrea Ml a flata Eafie 



and storea in a database 
ding. Th e recorflings are 



assessmen 



ana recording 



andsat arrangement is. shown in Fig 9A. A Landsat 



multiplexed toget 
it ion. tn~ --~ 



c transmission to the groynd station in, The grount 
be deimjlt ip^iexed wi th demultiplexer a lie and loadec 



station, tng images 
into a database 911D 



can 
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-bands or 6 -images into 



tabase is processed as in 
ges can be -packed together 
^ckea into the same pixel 



wnrTin a singfe Jatajaase digitized into 

H-Mt in tensity word" per pixeT ifid aii "6 8-bit intensity words for 

an be pacJced togetner in to the same pixel word. Unpack 



spondingTpixell 
rle database. Fc 



image 



o an 

r a 

ing 



opera, 



jHe di 



atabase can be structured as 



-memory m ap Stored on disk memory. 



)ixeJ 



m 



fincHester dislcs to stor e the cpmplete image database . 

Corrections can be applied to the images. ~such 
:orrecfcions. geometric corrections, and other corrections 



as radiometric 
with device 9 lie 



c o r re c tio ns, geometric . corrections, -ant _ _ ^ 

toiiowing" storage IrTthe database . Alternately, corrections can be appliec 
prior to the images being stored in the database, sucfl as wmie tne images 



prior to' tne images being stored~in tne dat 
are being transmitted on "a pixel-by-pixel b 



asis 
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otner enhancements . 

I mage asses sme 
an opera-tor prior 



image enhancement: 



image to assess "the ima ge. The operator can control various enhancement 
capabilities to enhance fcHe image based upon the assessment. After the image 



has been assessed to be ap pro priate tor recording . the ; image can be recorded 
on recorder 911F. . . . . 

image re c ordi ng can, be performed with film, optical disks, video tape, 
md^ other media r Recording 6n tiim can be implemented with an arrangement 
•hat p'notograplis a CKT~ monitor having the desired images displayed thereon? 



>d images displayed thereon, 
can be performed with well-known 
. Recording can be _ made of 



a"*"se"re"cted 31 p3rtion" "or ~tfie" compTele""imager multiple "frame images or the 
complete image7 multiple frame i mages of "selected "portions of the complete 



ge QJ 



r ices . Recording can oe made ot 

ion . For example, recordings can 

e rng^T ,a single trame image ot. 



image , 
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or other selections. For example, a use 



to be recorded to 



select a single frame image 
U environment 




printing; such "as wj 
^ ^. 

. t ;3 , 

publishing applications can exceed iu- miiiion- pixels 
involve storing a large image in a database accessing 



or very-hign resolution images tor 
ishing. business graphics, and tape to film 
tra-high resolution images tor remote sensing 
- and very- high resolution images tor 
-millio n- 1 pixels. These applications 
base: accessing selected porti ons ot 



movi emaking appl i cat ions „ 

appli cations can exceed a bi 
publishing appiicat 



-ion 



the image from th p -^at-.abase: processing the accessed portions o£ the image ; 
and displaying or recoraing tne processed, Ql e Kw t- n nnn ^- Ql e 

Saffiliit:^ gi rpires "can otten cover 50 .TJOO^pijcelS by 50, QQQ- P.^el? 



j nvp lying Y. > - 51 ) 1 Vo n oi xei s . Pumisning industry images can cover 
IS :0 ffO -pixel s ' by 15 fiflft -pixels^ involving Tig - ma j 11 on bixei. s . impi ement at ion 
or an integrated c imn f memory map tor^sEbring f.his large number ot Pixels 
puia tie excessive 1 y expen sive . Tfowever . an arrangement tor storing suc^ 



,arge 
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imag 
a na 



in a data b ase: such as on a video disk, video tape, or magnetic dfrsK; 
.ww.^"-::- - r ; h e a pp rbpriate p brr.ions ot this image with the image 
- - ""^^ the presen t ~ invent. ion provides important 



en processing _ 

in _accordance wi 



Dill 



^iciencies. ^ viytTiTal scroll an image trom a 

ideo disk has been disclosed previously. , ^ 

and cartography applications are typical of svstpeins 



£1 



LID 

tc 



0^ 



. Remo t e s ens m 



requiring iiltra-nYgk rfiaolutTi6?1"^ es J Remote sensing^ applications include 
satellite scanners- siicn as "in Jbancrsat applications, and'aircratt sens ors^ 
such as in reconnaissanc e applications, cartography applications includes map 



^ ~ „ --.cations . ^^^^a, n ggc „ ^_n n . — -^„.^.- — 

making tor military, comm ercial, and consumer applications. ~ ~ 

Landsat lnages are available tor military and non r military applications^. 

The Defense Mapping Agency f DMA i processes such images — and makes, , them 

available tor miTitary and nt3n-mili nary use . in the near tuture. non-mill 



p plicatJ 
id non-m 



EE 



it! 
Ill 



satellites i will gVn^at p large Aiafi detail images tor commercial 
a pplications. ; cgnroanies invoi v e-Q i n "e xploration, such a s tor mj, and 
Mfterals: in weatrfer . sucn as tv network anJ airlines ; in geograpny . such 



irv_usi 
nigh 



tary 

cial 



real estate developers; and government agencies needing inrorffiation_Qn 

weather, troop and equipment mo vements, and other situations will oUtam 
images tor analysis, 
^ Geographical n 



of the type foun d in World Atlas books: 




trom 
as m a 



479 



slide projector. The system of the present invention provides real time 
interactive ima ge processing to examine such images in an etticient 
interact ive man ner? "~7 ' ~. . . 7^ 77- ~. 

^rintincf qt very-high resolution images is used in majiy applications 



such as T pupjishing. business grapnics. and movie appi^catiqi 
resolution images can hav e more than lu-million pixels^. Special 
Been developed tor exposing verv-high resolution images on t: 



,n, many applications; 

licatlqnsr Very-high 



^r^y stems nave 

d~tne~ freledyne" camera" system tor" 
h systems riave limited image processing 



resolution image s can nave more "than 10-milli 
Been dev eloped: tor exposing very-high resoi 
Dicomed system tor ibjpm slides ^nd tne" Tele 
film movie edit 



ut ion" images orTT: 



such the 
tor tape to 



;mg, 



lowever f 



sue 



capabilities 

r The system of the present invention has the capability to accomodate 
very large images" limited in Retail o nly t)y tne capacity oi: the database. 



Tne'se'Tmages "c an be geometrically processe 



Ear 

ot: 



processed tor editing an 



:ere 



d otherwise 

or prov iding exotic special ettectB ftetQre 

apability ip important for 



printing 

~ ReaT time interacti ve geometric processing capability is 
fficiem: oper ator interaction. Such capability indiude 
nteractive rotation, t ranslation, continuous (non- integer ) 



ndiudes reaj 



interactive rot ation, translation, continuous (non- integer ) expansion anc 

id ' 



compress ion f and warping. 
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For example 



can visually 




doctor viewing 



over the 



swing an X-ray o*\a cartographer examining a»wp 

---- imagfe to tind a teature^ot interest . gfeoomff jr n 

teatyire close up, "and rotate" the image to^ change "its 



clQser to se 



Tso7 warping provided tfre" ^ capability to "remove" "distortions? 

_ — - anomalies : to remove - eft ects . 'such as BD-perspective 

Compressing the image at more remote locations: and to match up dilterent 



orientation. . ^_ 

such as lens anomalies : ' t"o remove 



images tox comparison. 
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Image Processing workstation Application 

An image pro cessing workstation can be used in many applications ; such 
as processing dt large ima ge s ,, ^ dustr^i .arts,,, gr.apft.ic^artgl bu§iness graphs 



Ic s, and others " sucri a workstation" will £>e" ^lTiustfated" with a discussiorioT 
a Landsat image processing workstation with reference to Fig iib. " " 

~--^~ ?KA^zf~^ y-?j^y a ^Afs 93^P & .sp^j-^j^ ^gf^ a . M g£gg d :? lo g e 



workstation £ or Viewing a large 17 anosa"f i mage . Viewing bl: large "images ( l .Ha 
Jfo8-miiliqn pixels) can he ^>errormea to^naxijuim resolution tor; assessTn 
details ot tne image, a r maximum compression tor assessing the wnole imag 



etails ot tne image . "at ma^tEim cbtmresaion ~ 

imulta_nej3usly_on i i^jzA'^^^^o Xj^ap^jLt, any, ieyej,_pj:, p^gans^gn/cgmpressg^a 



inbetwee n ITnese limi ts lor t^e de sire J i bt detail gpnsisfcent witi 

range anb resblutibn o£ tn e C-itr monitor ^Ijie operator can translate over trie 
image tor viewing bit ter ent portions of t.he image and can rotate tne image 



2U£ 

I- 



r , ana at. any. 
desired levgi 



N 



for,, viewing different orient at ions o£ jhe mge . All , operations can he 
performed m . real "Tame . updating the uki monitor at a |U - trameper sec ond 
faEe for s moot n conti n ^ a nq cp mpre s sn on capaP3.A3.ty range 
from Ths whole image Tiding co m pres sea tor giimur.aneous viewing on the CRT 
" Mtor^firo^^ View ing 
tails on rue crt monitor. ~ , _ ' ... , , 



mdh i t or t h rough "a hi gh J 
details on the CRT mom 
Tne wori csr.ar.iQn~ 
systenu nousea in an 



y expanaec 
for . ~ 

- -------- -nr. "viewing ot - ~~ ' — 



operator nan be seat.etf %h W^.erminai,- 91QC fo r convenient- viewing OE a color 
(W mnnlfaor and an alphan ume r ic /ovst i ck COnKroi fl can PrQVlfle tor 



"mica 



loured as , 

rminal. Joys 



rota 



monitor 
xing. 
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anti-ali asing sttjootnincr ana lriterpplation : ar 
r.pnvene a Efie digi ti ai geome t r 1 cai iv ana spa 1 1 ax i v 
Video sig nals Ttfr fixcinna be^RT J monitor A 
is provid ed tor control ot system operations ant3 
tor^aisK accesses" "and communication witn the nog 
image Int ormation "from host computer 91UA < 
with buTfer memory QlflF tor compression processing 



expansion, ana compression; tne spatial 

y a¥c[ spaHaiiy processea information into 
p J moni^of ViuL._a ^^ e^^or^ BrQceggQr.gj.Qg 



c system,. operations, anticipatory memcm 
kmtihi cation with ^ne'host coi^ut.e.r.-^Ai'A 
rom Fost f computer Mu£ or diSK 91UD car 



management 

•cart be loaded 



or compress] 




lessor 



ompressen - intormation 



LOX 



geometric -processing or can oe 



orage 
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rrup 

consid erations 
Two 



_ representative configurations are specified in the IMAGE PROCESSING 
WORKSTATION^ TABLE . 

484 

Image Processing Workstation Table from Specification omitted herein 
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ot 1S otner~qatar>ase memory arrangements 
the present invention p'rgyiaes n 



leased system as 



video system tpget ner* wi?n the treedbm'ot ftd£ign ot the <!onventiona 
video game systems, it provides unlimited treedom ot mot 
:ne pixel resolu tion o"t a video disk: and ckt monit' 



ign quality imagery of 
Ene ffonvenf. i onai afraph 
motion, consistent wi 



signitic 



mo er q 



^ and CRT mom 

rom any parcel to any of t.he artT agents pixels in any direction- yeT. re 




ffie~ 

tabl 



ian 



at abase oi 
thl 

with a geometric 
conventional video^ 



; mot^n, 

QireflFic 



d ~a~sighirVcahtiy 



images can move 



gK_ £>ased^ game^ agPgO agngS 



.IS 1 

introduc ing motion 
frames required. ~ 



oring stat 



anc 



mu 1 1 in i e r equnaarH 
to provide limitec 



as 



iulliple redundant frames 



iae lir 
ctant tj 



motion an 



accesses necessan 



-o reac 



is overcome py tne presents image processor . Tne geometric processor can 
modify a stat i J c frame or an overlapping group ot static frames to provide 



.5 




provided r.nverina a 
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wide range of ar ea to be flown over 
rnta^s and translates over the .oro — 
1 r -- Ene apn earance tnat the ope 



£6 

?rat 



operato r ran fly the plane, which 
errain under pxlbp -piaver control ; 
is ar.hnaiJy tlvin- — 



rovjcuna 



e operat or "can change altitude. 
d terrai n to >e compressed and 



kt an a J, 
aTiqe alt 



yer a man dears 



here mc reas 



ot "treedpm grouM 
m _ altitude cause t 



e ground terrain to be expanded 
- ted und er operator contro 



q grown 



S 



compressed ana 
as rue terrain 
Further visual 



iguMc-.n^^u image compression, where tor example ^-#n 

manuever shows te rrgin at^a_grea^er_range i ,_SUCh a | n f ar , nc j| ^ 



aircraft banking 



horizon" lo'be m ore compressed and terrain 



aircratt. to b e less compressed fhis — proyiQes a — -i -qimensionai 
pectjve tor depth perception ana distance perception . TT~7 
y fi "database W /m Tges r can be sTored oil "a~ va Tdeo dusk. Sufficient 
rmation can be stored on a small video disk to permit an operator to 



a lesser range 



royides 



ill 



as unde 



£ 



the aircraft. to be less compress,e 
perspective tor 



info 



images stored on a smai i video disk". ~An operator can control _ 
scenario to follow a virtually unlimited number ot paths . Also yi 
access jca Ees arjT E^ j sma^l u n^mPer Q 



rates are rel 
d from video d3 
; images . den 



vide 



ame 
HE 



>" Small' number o]t" frames 
_de multitudes of displ 



, lisk can 'ne processed to provide multitudes ot 

dynamic" images . derived by geometrically Processing the single acc esse, 
frame 7 This furth er reduces dependence 6n ° video disk operation; wh 
relatively 



accesse 



piay<; 
cess€ 



iere 
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gimple^ low cap acity, slow access rate, and less rugged video disk drive can 

ae usea. derived, by accessing — static — non- redvmdent — visua 

information "from a' video disF and then processing the static store 
inf ormat ion to provide dyn amic visual intormatrion under interactive operator 
control , a sl^ be geometrically processed to 



control , a single frame of static imagery can be geometrically processed to 
generate multitud es ot frame s~g£ dynamic imagery, unequal image compression 
and ima"ge>:^ansion simulates the more sophisticated iD-perspeetive ettects. 



mage expansion simulates tne more sophisticated JD-perspeetive ettects. 
Adaitioria l capability"' includes a nigfi detail moving pacKgroung ana high 
l moving obTe^ts i in J tl>e"fc or eground- occulting or obscuring the more re- 



de t a lpnovina pbiects in' the ± or ear ound be cu 
mote background^ imagery behind the' foreground 
des the effect- of slower motion tor a mo 



foreground moving obi ects. jP^PerspgCtiVe 
motion tor a more remote background" and faster 



Xon e |o r be less remote foreground imagery to enhance real ism. ~~ m . 
An aircratt example will now be provided "to illustrate capabilities. The 



background imager y cafl include around patterns consist ing oi 

-■ Tround patterns: s V ct l as four"- 

irs . yt&B textur ed by 



ckground 1 can 



others . 

photographs, such as 
are accessed and 



-2. 

arid" ex; 



red ba 
used t( 



or map making: 

amically " " 



± 



roceased' 



fag 



is Q 



e st; 



[US 



pre-recc 



terraihTTthe static pre-recorded images are accessed from database 
are rotated and translated to provide the appearance ot a moving 



-ies a 



over 



ase memory anc 



488 

As the operator i ncreases or decreases the aircraft altitude, the 



background . As the operator i ncreases or decreases the aircrL, . 

background terrain is expanded or com pressed respectively to provide the 

-_--_-„_-_ . „-_ j --.. f ^_ ^„- ot V1 ew~ causes the 

screen to be increased as altitude 



appearance dt increased or decreased 
amount ot compressed terrain seen or 



view] 



great 



le imagery at 
"y at 



imager; 



L tion ot the imagery at 

, T - n .. r -- T ion ot the imagery at" nearer 

ti stances " in accordance with 3D-perspective . Motion is continuous in real 
' -- -- -- ------ ---- - — - - -- - - ^unllmitecTin cTirection. motior^cnanges in 



aircraft 



"¥o enha nce iphe effect 
.osions superimposed on 
ts. Foreground .images , suchas 

and obscure othe r "images For 



aircraft and bomb explosion lm, 
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this textured background need not be generated with animation — but — can 
ggpraWwTffi sTaTfc^^ /s g e n e ^ 

spf r? Static images sfcpred on v irteo^ disJc are accessed and dynamically 
processed go provide r^gafed - tr^n^atRa ca^ T^^AT and expanded [ dynamic 
versions or gfie static pre -record^ mSEionT Ks "the 

operator moves The Wn. *Fhe ^ af^pre-r ^rd ed imagej \re access ecf^ rom 
database memory and arp 'roFahed w and tf anslat^ert to provide the appearance of 
«arl/rr/nnnrr flip nnsraPor increases or de'creases Ene distance trom 



is che hero . *tlie s>a>Xcyp^ images are accessed trom 

ry and are rotated and tr^ansl afed Eo provide the appearance, or, 
j/nnn7f As hne opraPor increases or ^^reases gi|t^ce;tr^ 



K^ o yTn g ^J#^ra^ 

the background: Ba ckground image ryis expanaed or compressealx 
provide r fy* appearancg or "increas eg pr_ aecrea sect jaisj^jnce , r 



tance from 
ctiveiv to 
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more remote images such a s background images and villi an images, and yillian 
images obscure all more remote im ages, such as background imagesT 

491 

492 



images 

NON- DISPLAY APPLICATIONS 



General Description 

Various applications Of, 

non-dTpplay applications : _ such 




ion-display applications; sucn 
md ar£iti6iaf^inteiiigence~ap 
lispiay applications in that t 



per "second ""the" number or d ifferent types ; of tTlterihg operations thafc canape 
- on an lmage'pe^ secondT and^fe j?>xei per second tjirougftput _qt _ the , 



iyalgm. ' >isor tne overlay 
erein facilitates multiple c'riannei pattern recognition-type capability 
on-display applications: such as 



non-display app l 



in 
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for parallel pipeline .processing. Therefore, the — same capability, , that 

facilitat es smoStfl real time operat ion and overlays Tor dispiay-appiicataons^ 
as cfisc usseci hereinT provides comparable advantages tor non-displav 
a pplications ! . . 

£opotics rebates to indus trial automation applications . An image can be 
ca ptured^ y a vldep ^ 



captured by a video camera. cUgitJ-Zec 

image can j>e geometrically processed 
spatially filtered to, enhance recocrni; 



:o regist er with a reference image, 
features, and used to control a 



parts, .pais 



.sua 



d upon 
l guide 



to move from a .fixed position. T he image processor discussed herein car 
provide such visual gu idance, sucn nracfliines include guigeq weapons!! 

satellites, aircratfc" 1 ^^ ~ s ^^Cj^^, ana~evep Spax Vjar^s &4P2 typf robots. 



satellites, aircraft, land vehicles, and eyen Star Wars RZD2 type robots . 
Guided weapons, such as cruise missiles and intelligent bombs, can be guided 
using micT- course and terminal visual guidance systems, satellites can be 
nnsiYmnpri and nn enter! and spacecraft can he docked usi ng visual control 



rented 

licit 
-owinc 



image processor discussed herein provides re g i stration a nd filtering Of 
images "tor display and for 
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automatic 



warding oa 




arge cons 



also sensed to compensate tor rJ aistortions. sucn as with wamng 
range p e r specf 1 ve 3tt :ect Ts and camera lens ettects . (teometric^ 
permit s"an^operft pr f.o invMi-iaaEe an image.- such as by roamM. 



warping to remove 




assess 



_ rocess 

roaming over 



38 



image wim 



at ion . rotating co orien 



lent a, . , 

n greater detail 7" ana compressing to looK EQg ptfler 
an be used to ennance the Image r such to to enhance 
Tealures CU TRe YegTs^eref anlf Tilt erect, gpl 



eature oi 



see 



ure in greate 



matures 



ermg 
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Pattern Recognition. ... , , 

The pres ent image processing invention — can — be used, in various 

needing automa t ic pattern recognition capability . These include 
>A on systems. J nom ing systems , ~ remote control systems and 
tV to 'rotate, tra nslate, and scale an image r^ciiifcatfia 
iitvot Images . such as comparing an acquired image and a 





pattern recognition. 
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There are various types of edge detection, such, as for pattern 
recognition and image enhancement. These include convolution and shift and 
subtraction. . , , 

'" lonvolut j,On Can b Q T-.i-i-.-tn HoH t.th t-Vi wo n rr n t- a chal- ernno prlnpq PYnann pnnpR 



Convolute 

convolution witn nigner latituge can aiso pe proviaea. xne co 
ich can "process k ernel intensities to provide a new output in 
pixeT: This T can ae Implemented by using the input to tne welff 
tne kernel pixel lntensitiesT and the^ output or" the weight tap 
»w Inten sify tor the center pixel. For example, it tne intena 



e provide d with weights that erode edges, expand edges. 
liigher l atitude can alac i be provided. The convolution 
eernel in tensities to provide" a new output intensities 



etc . 

approach" 



Pie, 



nemf EnepKernei pixel intensities, and the output pf^tHe weight table 
the ftew Intensity tor the center pixel . For example, it the intensit 
ggualT a zero-in tensity output is provided and it tjnere is a ~cm 
intensity an arorppriate J nonffero intensity is output. This is ettect 
ditterentiaticfif rrirm or table iookup. ~77 7 



)eing 



les are 
change in 



us is eft actively a 



appropriate- non-zero intensity is output 
arentiati dtf tdrm ot table looKup/ ~7~~ , . _ 

Another way" to detect edges is to shift an image, such as one Pixel to 
the r%gK€ * and then subtract t-he shifted ^mage trom ^he, ,unshit ted ^mage^ 



^n|ensity _aii apprppriatg 



ocp.qgi fig nt r error >i gnal s wi IT now Be "discussed .Erf of signals can be 
derived^ ^that afe indicative of differences, ir 



rid other spatial characteristic s between different images. For exampleT 
eatures or acquired^ and reference im ages can be identified and the 
If Eerence in "the x -posit ion and ^-position ot the teatures in the acquirec 



LV£ 

25 



3 



sit ion, orient 



:xon, scale, 



image and the ~ refere nce image " caff 
Identifi cation ot various image 
relat 
otner 



8 



|aj 



ignals ." 



_, , as error 

ntitication ot various image teatures and measurement ot alignment errors 
ated thereto > can be used "to determine p osition, orientation, scale, and 
er characteristics ot an acquired image" . 



measure 
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nulling approach may Joe considere 



: features are de termined. The tprmer 
e a sequential n ulling configuration: 
r associated wit h a tirst teature and 
en determining a registration error 
Limg !Wis second teature error while 
then det ermining^ a registration error 
liing th is third teature error while 
led, ^and "so forth ." The latter nulling 
:allel nu lling configuration; such as 
plurality" of teatures and solving 
trie equations, tor determining each 



sucn as identifying; a registration error associated with a first teature 

nulling tnis "fir st teature" error, tnen determining a registration error 



nulling this, .first featy 
associated with a second ft 
Keeping .the x^xst teature j 



eature ai 



eeping Jthef p.rgt feature .error nulled, 
ss^oc rated with a third teature aridn 
the tirst two lea ~ 



.-eeping t he first two teature errors nu] 
approach may be considered to be a 
measuring error s associated with a 
It leal " - 



e a para 



matHematical e^atioi^." suc^h as parameffic "egiiations lor determining each 
error as a functi on of the positions ot a plurality of teatures. 

Alternately, a cor relation or convolution spatial Entering nulling 
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rpvfr a greater " spatiai ranae . Decause the images may initially beZwX 

rnisaiigne d. and tine alignment can cover a lower spatial range. TDecauH 

images may liave already been coarse aligned with a coarse alignment 
onerationT TheretoreT co ar se alig nment may require greater spatial range .but 
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opfifatiohT Therefore: co afse alig nrngnt: may require greater spatial range, bu 
to lesserspatial resolution, "and tine alignment may require smaller SPatia 
range , but ~to greater spatial resolution 
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In one configurat; 
rapidly bring i mages into 



implemented" to mo re precisely al ign the images . and a measurement mode may b 
im plemented tor 1 mo r> precise measurement: "or image teatures and nulling o 
alignment errors . la& ot a "piuraiifcy^ ot modes can be implemented wit 
differen t resolutions 7 consistent wiEji J the operations to be performed. For 
example, a coarse alignment mode can be implemented to coarse resolution, r 
tine* alig nment mode T can" be implemented to t filer resolution . and a measuremen 
mode can" be implemented to still tiner resolution 
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Inspection Applications . . , , . 

Automatic inspection applications will now be discussed as illustrative 
trious : ' ^ ' 

vEnerwii 

gling p — r , ^ 
-^e— example, it il . 

of a f eature of the — _ „ „ r 

tne part stored in memory map form". A video camera can acquire an actuaT 
r—j t:li e part on tne -assembly Tine . The acquired image Can be compared 



of various image processing app lications for measuring, locating, correcting. 
and otherwise dperating o f "images. For example. an assembly line Having parts 
traveling Jown The fine can nave parts misaligned to the assembly line . _ For 
this example, it is desireab_le t o determine dimensions ot a part and location 
of a feature of the part 
tne part stored in memo 
image of the part on tne 
with the reference image 

can translate, rotate/,] 



can translate, r otate and expand or . compress the reference ima< 
ac quired image t o null errori ana to anan tne reierence lmagS anc 
acquired image . 

The referen ce image can be driven with driving functions to track 
movement or the acquired" image as it proceeds down the assembly line. Driving 




images can be used" 

between images that are 
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already aligned can be determined for measurement of tolerances of the part 



already aligned can be determined for measurement of tolerances of the part 
on the;p roduction line.- i.e.. alignment ot corners of a cube can be used tor 
initial alignment and measurement "of errors ot other teatures ot the cube can 
be used- to "determine tolerances 
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Various Tables and Program Listings from Specification omitted herein 
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DISCLOSURE DOCUMENT 

, A disclosure document has been filed in the U.S. Patent and Trademark 

Office on or about October 18, 1984 No. which is herein incorporated 

by reference. This disclosure document Y\'dS copies of many of the documents 
and specification sheets referenced herein as follows. 

1. National Semiconductor specification sheet for the MM5321 synchronization 
generator. 

2. Signetics specification sheet for the ST95, 96, 97, 98 hex 
buff erg/inverters . 

3. National Semiconductor specification sheet for the ADc 0800 A/D converter 

4. Texas Instruments specification sheet for the TNS-4016 RAM. 

5., TRW specification sheet for the TDC1016J-8, TDC1016J-9, TDC1016J-10 video 
D/A qonve^ters . 

6. Mitsubishi Electric specification sheet for the 1458725P, S;P-15, S-15, 
RAMS . lit 

7 . Computer Compatible Joystick Instruction sheet. 

8. CcpmpuPro CPLT 8085/88 Technical Manual. 

9. Viewpoint/3A Plus User's Manual. 

10. CompuPro RAM 17 Technical Manual. 

11. CompuPro RAM 16 Technical Manual. 

12. CompuPro 8080 Multi-User Monitor program listinq. 

13. CouLpuPro, System Support 1 User Manual. 

14. International Instrumentation Incorporated Universal Disk Enclosures 
manual . 

15. Siemens OEM Floppy Disk Drive FDD 100-8 manual. 
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16. ColipuPro Disk 1 User Manual. 
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